-- Logs begin at Tue 2021-10-12 16:04:53 UTC, end at Tue 2021-10-12 17:10:14 UTC. -- Oct 12 16:34:46.147050 dv-cinder-813221-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 16:34:46.155355 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 12 16:34:46 2021] *** Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: nodename: dv-cinder-813221-2-iscsi Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: machine: x86_64 Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: clock source: unix Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: pcre jit disabled Oct 12 16:34:46.157346 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: detected number of CPU cores: 4 Oct 12 16:34:46.158294 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: current working directory: / Oct 12 16:34:46.158294 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: detected binary path: /usr/bin/uwsgi-core Oct 12 16:34:46.160240 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: your processes number limit is 47680 Oct 12 16:34:46.160240 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: your memory page size is 4096 bytes Oct 12 16:34:46.160240 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: detected max file descriptor number: 2048 Oct 12 16:34:46.160240 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: lock engine: pthread robust mutexes Oct 12 16:34:46.160240 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: thunder lock: enabled Oct 12 16:34:46.160240 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 16:34:46.160240 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 12 16:34:46.205755 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: Python main interpreter initialized at 0x5640b33089c0 Oct 12 16:34:46.205755 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: python threads support enabled Oct 12 16:34:46.205755 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: your server socket listen backlog is limited to 100 connections Oct 12 16:34:46.205755 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: your mercy for graceful operations on workers is 90 seconds Oct 12 16:34:46.206149 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 16:34:46.206224 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: *** Operational MODE: preforking *** Oct 12 16:34:46.206470 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: *** uWSGI is running in multiple interpreter mode *** Oct 12 16:34:46.206470 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: spawned uWSGI master process (pid: 80056) Oct 12 16:34:46.206680 dv-cinder-813221-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 12 16:34:46.207793 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: spawned uWSGI worker 1 (pid: 80071, cores: 1) Oct 12 16:34:46.207793 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: spawned uWSGI worker 2 (pid: 80072, cores: 1) Oct 12 16:34:46.207793 dv-cinder-813221-2-iscsi devstack@keystone.service[80056]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 16:34:51.390948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:34:51.390948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: from cryptography.utils import int_from_bytes Oct 12 16:34:51.391737 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:34:51.391737 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: from cryptography.utils import int_from_bytes Oct 12 16:34:51.392127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:34:51.392127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: from cryptography.utils import int_from_bytes Oct 12 16:34:51.392578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 16:34:51.392578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: from cryptography.utils import int_from_bytes Oct 12 16:34:51.441022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 16:34:51.441217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 16:34:51.441418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] command line args: [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 16:34:51.441695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 16:34:51.441873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ================================================================================ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 16:34:51.442133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] admin_token = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.442378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config_dir = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.442587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.442749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] config_source = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.442929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] debug = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.443012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 16:34:51.443251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.443512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 16:34:51.443512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] command line args: [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 16:34:51.443643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.443719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.443804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 16:34:51.444049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ================================================================================ {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 16:34:51.444210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] admin_token = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] config_dir = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_config_append = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] config_source = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.444973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_dir = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] debug = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445827 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.445943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] list_limit = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] log_config_append = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.446968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] log_dir = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447089 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] log_file = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.447973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.448055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.448187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.448304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.448495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.449107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.449185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.449433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.449564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.449672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.449749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] publish_errors = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.449929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.450068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.450195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.450335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.450335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.450640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.450783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.450971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] standard_threads = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] publish_errors = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.451965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_journal = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_json = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_stderr = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] use_syslog = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.452775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.452860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.453005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] standard_threads = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.453080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.453239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.453322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.453508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.453593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.453688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.453770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.453865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] use_journal = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.453984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.454071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] use_json = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.454202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] use_stderr = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.454283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.454378 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] use_syslog = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.454454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.454608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 16:34:51.454759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.454864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.454946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.455911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.456874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.457874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.458972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.459928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.460966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.461917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462760 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.462995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463548 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.463932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.464013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.464191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.464267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.464563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.464730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.464910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.465074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.465236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.465435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.465582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.465709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.465845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.465923 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466305 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.466928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.467953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468692 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.468916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469479 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.469937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470166 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.470888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.471986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.472996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.473952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474579 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.external = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.474911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475393 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.password = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] auth.token = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.475977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] auth.external = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.476951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] auth.password = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.477928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] auth.token = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478254 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.478948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] credential.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.479908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480079 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.480929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.481909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482632 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.482881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483037 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483288 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.483901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484011 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484489 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.484973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.485930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486166 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.486961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487824 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.487917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.488958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489518 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.489998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.490990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.491935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.492856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493754 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.493987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.494931 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.495014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.495156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.495763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.495919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.496977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.497893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.498992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.499993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.500963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501191 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.501920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.502891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503764 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.503842 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.504942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.505074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.505215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.505342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.505496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.505625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.505760 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.505888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506305 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.506924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507254 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.507959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.508080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.508215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.508320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.508453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.508583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.508814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.508951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.509981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.510099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.510219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.510298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] role.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.510465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.510809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] role.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.510932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.511534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.511612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.511682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.511751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.511821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.511970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.512960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.513947 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.514118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.514214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.514352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.514430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.514606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.514780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.514857 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.515877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.516991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.517968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.518939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.519878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.520856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.521986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522064 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.522931 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.523888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.connection = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.524989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.525975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.526131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.526209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 16:34:51.526392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.526675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.526910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.527160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.527396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.527639 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.527870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.528110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.528350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 16:34:51.528519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 16:34:51.556001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.556228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.556316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.556460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.556545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.556761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.566985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.567864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.595565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.595791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.598602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.598840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.648753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.649116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.789405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.789670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.789853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.790091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.856135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.856362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.856452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.856577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.856663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.856796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.856880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.857015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.857107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.857230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.857313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.857476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.881861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.882968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.883050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.883180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.883272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.883411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.894446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.894572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.907417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.907599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.907689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.907827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.907911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80071) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.908916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80072) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 16:34:51.927276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.927508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:34:51.927619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.927752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:34:51.927858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.927981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:34:51.928058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.928231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 16:34:51.928314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.928498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.928582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.928757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.928838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.929010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.929101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.929262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.940360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.940633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.940903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.941188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.941331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.941594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.941867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.942147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.951133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.952022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.954368 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.954649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.954929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.955209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.955304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.955484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.955571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.955745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.955825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.956892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.957080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.957159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.957343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.957639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.957904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.983519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.984079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.985088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.985388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.985669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.985963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.990539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.990810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.991090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.991186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.991400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.991688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.998909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.999192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:51.999317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:51.999600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.003560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.003849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.003944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.004132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.004226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.004415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.004507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.004691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.004792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.004972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.005087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.005237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.005329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.005533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.005626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.005812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.023868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.024004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.024141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.024281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.028656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.028744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.032243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.032380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.032534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.032671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.037654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.037750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.041145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.041243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.045231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.045345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.045549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.045638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.045833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.045920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.046115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.046203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.046392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.046485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.046690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.046775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.066141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.066240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.066424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.066508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.066690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.066774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.066952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.067036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.074601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.074696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.076401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.076496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.076681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.076773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.079682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.079837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.079959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.080117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.080245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.080398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.080537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.080694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.080808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.080974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.093853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.094049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.094137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.094329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.094413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.094609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.094692 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.094898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.094981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.095179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.095274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.095454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.095535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.095727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.113232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.113804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.116428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.116978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.119777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.120227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.121904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.122370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.123490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.123767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.124060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.124155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.124357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.124643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.131225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.131828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.132799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.133428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.136079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.136374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.136576 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.136659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.136862 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.136947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.137145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.137457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.145727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.146019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.146303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.146501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.146786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.147064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.154041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80072) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.154319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.154596 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.154723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80071) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 16:34:52.154868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.155979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.156173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.156263 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.156524 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.156625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.156718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.156795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.157000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.157081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.157262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.157352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.157594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80072) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.157683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.157874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.158139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.158415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80071) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 16:34:52.196684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640b33089c0 pid: 80072 (default app) Oct 12 16:34:52.196825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640b33089c0 pid: 80071 (default app) Oct 12 16:34:52.200031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ec5d-98f3-4a30-b1b2-d2ba783a2f8e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:34:52.200319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ec5d-98f3-4a30-b1b2-d2ba783a2f8e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:34:52.200598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88ec5d-98f3-4a30-b1b2-d2ba783a2f8e None None] PATH_INFO: `/v3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:34:52.204917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Tue Oct 12 16:34:52 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:00.199467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f42e8-5662-4164-83ea-0cfd2763e5e5 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:00.200017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f42e8-5662-4164-83ea-0cfd2763e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:00.200017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f42e8-5662-4164-83ea-0cfd2763e5e5 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:00.205097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:00 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:00.211594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:00.212110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:00.212218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:00.242153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG oslo_db.sqlalchemy.engines [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 16:35:00.437901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG passlib.handlers.bcrypt [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80072) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 16:35:00.438240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG passlib.handlers.bcrypt [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80072) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 16:35:00.495676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:00.497293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:00.635800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:00.783172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f42e8-5662-4164-83ea-0cfd2763e5e5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:00.817216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG oslo_db.sqlalchemy.engines [None req-889f42e8-5662-4164-83ea-0cfd2763e5e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 16:35:00.948931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f42e8-5662-4164-83ea-0cfd2763e5e5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:00.954002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d3d82-397a-4dad-bef8-3e63e0c1d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:00.954877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3d82-397a-4dad-bef8-3e63e0c1d301 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:00.955169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3d82-397a-4dad-bef8-3e63e0c1d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:00.955484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3d82-397a-4dad-bef8-3e63e0c1d301 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:00.964694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d3d82-397a-4dad-bef8-3e63e0c1d301 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:01.021538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.common.rbac_enforcer.enforcer [None req-205d3d82-397a-4dad-bef8-3e63e0c1d301 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 16:35:01.022030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d3d82-397a-4dad-bef8-3e63e0c1d301 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:01.032262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:01.039367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:01.054151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d884bbf-7b9b-4ec1-adc1-8f163c340a10 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:01.058661 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa939de9-887e-4d20-ae5b-e1211e27e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:01.059771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939de9-887e-4d20-ae5b-e1211e27e1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:01.060063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939de9-887e-4d20-ae5b-e1211e27e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:01.060896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939de9-887e-4d20-ae5b-e1211e27e1d9 admin admin] PATH_INFO: `/v3/projects/64da0972f6f84075a0e8956810e3e6c1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:01.062490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939de9-887e-4d20-ae5b-e1211e27e1d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=64da0972f6f84075a0e8956810e3e6c1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:01.113437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aa939de9-887e-4d20-ae5b-e1211e27e1d9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 16:35:01.113830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa939de9-887e-4d20-ae5b-e1211e27e1d9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:01.118480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:01 2021] GET /identity/v3/projects/64da0972f6f84075a0e8956810e3e6c1 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:03.327266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e999f-8500-4328-bddf-bb894cc2bed0 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:03.327836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e999f-8500-4328-bddf-bb894cc2bed0 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:03.327836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e999f-8500-4328-bddf-bb894cc2bed0 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:03.332486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:03 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:03.339297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30130d39-87c6-41a4-a770-3b5aef3134ea None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:03.339745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30130d39-87c6-41a4-a770-3b5aef3134ea None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:03.339854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30130d39-87c6-41a4-a770-3b5aef3134ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:03.360254 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-30130d39-87c6-41a4-a770-3b5aef3134ea None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:03.361911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-30130d39-87c6-41a4-a770-3b5aef3134ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:03.369901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:03.393557 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e999f-8500-4328-bddf-bb894cc2bed0 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:03.406467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e999f-8500-4328-bddf-bb894cc2bed0 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:03.410700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d34af-bcf7-4884-805f-7a084d40fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:03.411335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d34af-bcf7-4884-805f-7a084d40fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:03.411624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d34af-bcf7-4884-805f-7a084d40fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:03.411906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d34af-bcf7-4884-805f-7a084d40fa77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:03.419421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d34af-bcf7-4884-805f-7a084d40fa77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:03.421211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d34af-bcf7-4884-805f-7a084d40fa77 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:03.429875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:03.436443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30130d39-87c6-41a4-a770-3b5aef3134ea None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:03.445580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30130d39-87c6-41a4-a770-3b5aef3134ea None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:03.449948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852ff8a-de02-465f-987d-da13fbc79daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:03.450807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ff8a-de02-465f-987d-da13fbc79daa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:03.451096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ff8a-de02-465f-987d-da13fbc79daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:03.451989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ff8a-de02-465f-987d-da13fbc79daa admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:03.453422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852ff8a-de02-465f-987d-da13fbc79daa admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:03.455273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852ff8a-de02-465f-987d-da13fbc79daa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:03.456850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:03 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:05.753008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef9f1-693b-4f1e-bd73-43ffd74029ba None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.753581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef9f1-693b-4f1e-bd73-43ffd74029ba None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.753581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ef9f1-693b-4f1e-bd73-43ffd74029ba None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.755361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:05.761472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6c8cd-c11e-45de-a26e-089ec125901c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.761878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6c8cd-c11e-45de-a26e-089ec125901c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.762022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6c8cd-c11e-45de-a26e-089ec125901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.773258 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92852-43b2-46a2-a964-a1d11d7cca72 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.773577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92852-43b2-46a2-a964-a1d11d7cca72 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.773859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92852-43b2-46a2-a964-a1d11d7cca72 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.775610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:05.780226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4cd6c8cd-c11e-45de-a26e-089ec125901c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:05.781273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.781459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4cd6c8cd-c11e-45de-a26e-089ec125901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:05.781592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.781877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.789286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:05.813440 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6c8cd-c11e-45de-a26e-089ec125901c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:05.822514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6c8cd-c11e-45de-a26e-089ec125901c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:05.822992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG passlib.handlers.bcrypt [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80071) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 16:35:05.823409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG passlib.handlers.bcrypt [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80071) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 16:35:05.827608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:05.828390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.828684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.828987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.841956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:05.848814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:05.849992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 7/13] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:05.856163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:05.865359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ac075-1480-4af4-9e62-e2d22fb876f8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:05.869669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:05.869789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:05.870297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.870586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.870864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.871268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:05.871617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:05.871970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:05.874286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:05.874286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:05.874286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:05.875195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:05.887944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 8/14] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:05.894926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:05.898935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 7/15] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:05.904442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b4117-3118-4b24-8d5f-5933ba604f92 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:05.908882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:05.909755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.910042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.910323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.911552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:05.913399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:05.914960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 9/16] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:05 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:05.921272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:05.921913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:05.931176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd5079-8d02-499c-b567-a88f99dc9d8e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:05.931725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b181753-aff9-40cc-bc0b-92e1f1e6e16f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:05.935636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:05.935975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:05.937146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.937291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.937463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.937618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.937745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.937900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.939372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:05.941140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:05.943024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 8/17] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:05.945709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:05.947457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:05.949204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:05.957640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 10/18] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:35:05.959163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bcacf-7657-4279-9ab5-8849798ad5e1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:05.963361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:05.963664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:05.964288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.964577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.964856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.965732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.domain.id=default, user.id=d4d408e2598343a193d18277dfdc0252) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:05.966049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:05.967772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:05.967772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:05.967772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:05.968949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe886b-6777-4294-8df4-4001019d07d5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:05.971561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfc403-dd2f-45d5-a2fb-056a29bda4b9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:05.980272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1343 bytes} [Tue Oct 12 16:35:05 2021] GET /identity/v3/role_assignments?user.id=d4d408e2598343a193d18277dfdc0252&scope.domain.id=default&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:05.981178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f8c0d-54d7-48a3-a647-758186c54640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:05.982032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f8c0d-54d7-48a3-a647-758186c54640 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:05.982324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f8c0d-54d7-48a3-a647-758186c54640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:05.982603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f8c0d-54d7-48a3-a647-758186c54640 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:05.983855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f8c0d-54d7-48a3-a647-758186c54640 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:05.985702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f8c0d-54d7-48a3-a647-758186c54640 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:05.987395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:08.858002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afffc7-c9d5-4437-8067-3d81fe0a68a2 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:08.858553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afffc7-c9d5-4437-8067-3d81fe0a68a2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:08.858553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afffc7-c9d5-4437-8067-3d81fe0a68a2 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:08.861273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:08.867786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca5bb-77d8-416c-8e59-584b05ac2187 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:08.868809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca5bb-77d8-416c-8e59-584b05ac2187 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:08.869295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ca5bb-77d8-416c-8e59-584b05ac2187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:08.890041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7d4ca5bb-77d8-416c-8e59-584b05ac2187 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:08.891618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7d4ca5bb-77d8-416c-8e59-584b05ac2187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:08.904827 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 12/22] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:08.941237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afffc7-c9d5-4437-8067-3d81fe0a68a2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:08.958695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afffc7-c9d5-4437-8067-3d81fe0a68a2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:08.969643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e4591-70ba-459b-84b5-a5687b235a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:08.970732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e4591-70ba-459b-84b5-a5687b235a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:08.971219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e4591-70ba-459b-84b5-a5687b235a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:08.971694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e4591-70ba-459b-84b5-a5687b235a6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:08.995326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b623-b9b7-4639-9405-7dd293e2577f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:08.995938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b623-b9b7-4639-9405-7dd293e2577f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:08.996419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b623-b9b7-4639-9405-7dd293e2577f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:08.999042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 13/23] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:09.010655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e4591-70ba-459b-84b5-a5687b235a6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.011642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3cfa1-dc8a-4737-bca3-6f3a731a488d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.011946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3cfa1-dc8a-4737-bca3-6f3a731a488d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.012239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3cfa1-dc8a-4737-bca3-6f3a731a488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.012851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e4591-70ba-459b-84b5-a5687b235a6e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.035668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-1c0e4591-70ba-459b-84b5-a5687b235a6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:09.037308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 11/24] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:09.041784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a3e2-5191-47ca-b283-206723327f57 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.042085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a3e2-5191-47ca-b283-206723327f57 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.042380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a3e2-5191-47ca-b283-206723327f57 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.044304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-01b3cfa1-dc8a-4737-bca3-6f3a731a488d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:09.044502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 12/25] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:09.045257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637a3e2-5191-47ca-b283-206723327f57 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.045868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-01b3cfa1-dc8a-4737-bca3-6f3a731a488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:09.061735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637a3e2-5191-47ca-b283-206723327f57 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.066793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.067963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.068453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.068935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.069917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:09.070448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.071664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:09.071664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:09.071664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:09.072908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.078273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:09.079207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301090-216d-4fc5-a982-79bc29e08fcd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.079510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301090-216d-4fc5-a982-79bc29e08fcd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.079802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301090-216d-4fc5-a982-79bc29e08fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.094314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 13/27] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:09.102649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.115343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f131039-2055-4572-882a-f36eec59331b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.121244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-74301090-216d-4fc5-a982-79bc29e08fcd None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:09.121244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-74301090-216d-4fc5-a982-79bc29e08fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:09.126198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.127101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.127589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.128087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.129014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.130339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:09.130339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:09.130339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:09.132098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.141225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:09.145505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301090-216d-4fc5-a982-79bc29e08fcd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.161414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301090-216d-4fc5-a982-79bc29e08fcd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.172883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.173591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.173882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.174164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.174942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.175962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:09.175962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:09.175962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:09.176877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.309438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 14/29] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:35:09 2021] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:09.310875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.372171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 16/30] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:35:09 2021] POST /identity/v3/roles => generated 219 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:09.455381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fa431-1324-4cd5-803b-7243aeda1a53 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.466089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.466940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.467227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.467510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.493954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:09.501074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:09.503286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 15/31] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:09.509913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.532865 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71eebf5-fbf7-4740-b707-1c6e3adf3d51 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.538721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.539817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.544241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.545029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.546113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:09.547293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.549477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.572328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 17/32] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:09.579209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.596230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943eb50-acc9-4dcd-a407-1fdee53b0db7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.605435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.606370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.606657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.606939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.610613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.612979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.615051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 16/33] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:09 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:09.621864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.632841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8c7ba-c0be-48f4-a38a-f98eea32b4bb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.638012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a730e-3038-497d-a11a-a89154245064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.639206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a730e-3038-497d-a11a-a89154245064 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.639707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a730e-3038-497d-a11a-a89154245064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.640229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a730e-3038-497d-a11a-a89154245064 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.641992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a730e-3038-497d-a11a-a89154245064 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.644163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a730e-3038-497d-a11a-a89154245064 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.646301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:09.653271 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:09.664872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c9472-1682-4710-85f5-8916c0513929 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:09.673975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb390895-d0f8-4f87-92e7-a7e407af7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:09.675215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb390895-d0f8-4f87-92e7-a7e407af7341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.675732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb390895-d0f8-4f87-92e7-a7e407af7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.676217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb390895-d0f8-4f87-92e7-a7e407af7341 admin admin] PATH_INFO: `/v3/domains/default/users/d4d408e2598343a193d18277dfdc0252/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.678583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb390895-d0f8-4f87-92e7-a7e407af7341 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d4d408e2598343a193d18277dfdc0252, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:09.680213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-fb390895-d0f8-4f87-92e7-a7e407af7341 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:09.680213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:09.680213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:09.682751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb390895-d0f8-4f87-92e7-a7e407af7341 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:09.716893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 17/35] 10.222.0.48 () {58 vars in 1382 bytes} [Tue Oct 12 16:35:09 2021] PUT /identity/v3/domains/default/users/d4d408e2598343a193d18277dfdc0252/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:09.855659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32572-7d04-453e-937b-a7d0146b1385 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.856314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32572-7d04-453e-937b-a7d0146b1385 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.856803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32572-7d04-453e-937b-a7d0146b1385 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.859239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:09.865747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9cb5-64b4-4596-83de-7ad9099f1ad7 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:09.866257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9cb5-64b4-4596-83de-7ad9099f1ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:09.866327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f9cb5-64b4-4596-83de-7ad9099f1ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:09.891848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ac9f9cb5-64b4-4596-83de-7ad9099f1ad7 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:09.893440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ac9f9cb5-64b4-4596-83de-7ad9099f1ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:09.977781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 18/37] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:10.008481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32572-7d04-453e-937b-a7d0146b1385 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:10.027102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32572-7d04-453e-937b-a7d0146b1385 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:10.032456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f5d4d-3a6d-42f9-b930-eda11c105b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:10.033325 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f5d4d-3a6d-42f9-b930-eda11c105b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.033902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f5d4d-3a6d-42f9-b930-eda11c105b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.034332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f5d4d-3a6d-42f9-b930-eda11c105b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.035271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f5d4d-3a6d-42f9-b930-eda11c105b89 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:10.037140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f5d4d-3a6d-42f9-b930-eda11c105b89 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:10.057709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:35:10 2021] POST /identity/v3/roles => generated 225 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:10.091775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcbdc-d682-402b-867f-a58b7fc739f4 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.092074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcbdc-d682-402b-867f-a58b7fc739f4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.092366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcbdc-d682-402b-867f-a58b7fc739f4 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.095198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 19/39] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:10.102531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846021-9446-4b6c-a2b5-0cd28f3df770 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.103054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846021-9446-4b6c-a2b5-0cd28f3df770 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.103494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c846021-9446-4b6c-a2b5-0cd28f3df770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.120327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22709-df51-451f-8bea-bc2a3199770d None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.120640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22709-df51-451f-8bea-bc2a3199770d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.120913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd22709-df51-451f-8bea-bc2a3199770d None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.122902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 20/40] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:10.123040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6c846021-9446-4b6c-a2b5-0cd28f3df770 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:10.124602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6c846021-9446-4b6c-a2b5-0cd28f3df770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:10.129911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2434-ab45-46ba-8561-2fef8880cd69 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.130243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2434-ab45-46ba-8561-2fef8880cd69 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.130498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2434-ab45-46ba-8561-2fef8880cd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.134154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 21/41] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:10.155643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b3cb2434-ab45-46ba-8561-2fef8880cd69 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:10.157553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b3cb2434-ab45-46ba-8561-2fef8880cd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:10.159569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c846021-9446-4b6c-a2b5-0cd28f3df770 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:10.167190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 21/42] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:10.170019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c846021-9446-4b6c-a2b5-0cd28f3df770 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:10.175428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:10.176353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.176646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.176990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.178572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:10.180510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:10.182410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:10.189636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2434-ab45-46ba-8561-2fef8880cd69 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:10.193328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:10.206582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2434-ab45-46ba-8561-2fef8880cd69 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:10.208619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954906e3-dbe1-45a0-9b7a-8e091d27bf8e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:10.212795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf6569-77d3-4b0f-954f-04e6fae821fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:10.213993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6569-77d3-4b0f-954f-04e6fae821fd admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.214546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6569-77d3-4b0f-954f-04e6fae821fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.214747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c68560-3ff7-429a-b5a9-1d689ab6904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:10.215366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf6569-77d3-4b0f-954f-04e6fae821fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.215489 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68560-3ff7-429a-b5a9-1d689ab6904b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:10.215727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68560-3ff7-429a-b5a9-1d689ab6904b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:10.215951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c68560-3ff7-429a-b5a9-1d689ab6904b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:10.216749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68560-3ff7-429a-b5a9-1d689ab6904b admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:10.217160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf6569-77d3-4b0f-954f-04e6fae821fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:10.218494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c68560-3ff7-429a-b5a9-1d689ab6904b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:10.219697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf6569-77d3-4b0f-954f-04e6fae821fd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:10.235971 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:35:10 2021] POST /identity/v3/roles => generated 223 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:10.253755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:35:10 2021] POST /identity/v3/projects => generated 312 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:12.108261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4d09-00b0-4080-af80-1d9b15e2d22a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.108766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4d09-00b0-4080-af80-1d9b15e2d22a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.108932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4d09-00b0-4080-af80-1d9b15e2d22a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.111322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 24/46] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:12.117249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c97e-83a9-441f-98f1-668e6d2c264f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.117695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c97e-83a9-441f-98f1-668e6d2c264f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.117854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c97e-83a9-441f-98f1-668e6d2c264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.136021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0367c97e-83a9-441f-98f1-668e6d2c264f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:12.137213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0367c97e-83a9-441f-98f1-668e6d2c264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:12.195226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 23/47] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:12.219466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4d09-00b0-4080-af80-1d9b15e2d22a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:12.231798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4d09-00b0-4080-af80-1d9b15e2d22a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:12.237267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:12.239210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.239505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.239864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.251140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:12.258118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:12.259249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:12.265584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c97e-83a9-441f-98f1-668e6d2c264f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:12.274654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c97e-83a9-441f-98f1-668e6d2c264f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:12.279295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:12.280029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.280394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.280761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.281646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:12.281964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:12.282983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:12.282983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:12.282983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:12.284062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:12.297771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 24/49] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:12.303950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:12.315071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec2561-485f-460d-93aa-cf69b008951e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:12.319690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:12.320530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.320817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.321096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.322338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:12.324154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:12.325741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 26/50] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:12 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:12.331796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:12.341611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f200b-5a26-4605-a3be-6845a6b43f0a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:12.346064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964c71d-5396-4f8e-8a3c-76111110b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:12.346840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c71d-5396-4f8e-8a3c-76111110b6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.347133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c71d-5396-4f8e-8a3c-76111110b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.347415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c71d-5396-4f8e-8a3c-76111110b6e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.348593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964c71d-5396-4f8e-8a3c-76111110b6e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:12.350340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964c71d-5396-4f8e-8a3c-76111110b6e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:12.351930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:12.358304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:12.368550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f9f44-a417-4a04-aca5-36a29f8a38c2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:12.373119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:12.373794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.374087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.374372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.375794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.domain.id=default, user.id=d4d408e2598343a193d18277dfdc0252) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:12.376217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:12.377310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:12.377310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:12.377310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:12.382788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd95d1e-7520-496a-8d4d-020dfa2ed084 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:12.393836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1343 bytes} [Tue Oct 12 16:35:12 2021] GET /identity/v3/role_assignments?user.id=d4d408e2598343a193d18277dfdc0252&scope.domain.id=default&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 530 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:12.557676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c315-9793-428c-a2a8-37751b21c6b9 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.557923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c315-9793-428c-a2a8-37751b21c6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.558206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8c315-9793-428c-a2a8-37751b21c6b9 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.560036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 26/53] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:12.566837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060920-a906-4341-bdec-83d965717a69 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.567130 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060920-a906-4341-bdec-83d965717a69 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.567420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46060920-a906-4341-bdec-83d965717a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.585872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-46060920-a906-4341-bdec-83d965717a69 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:12.587108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-46060920-a906-4341-bdec-83d965717a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:12.595354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 28/54] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:12.619863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8c315-9793-428c-a2a8-37751b21c6b9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:12.632522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8c315-9793-428c-a2a8-37751b21c6b9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:12.636855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4b5a-8bc8-4d2c-b943-274d3d5529a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:12.637669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b5a-8bc8-4d2c-b943-274d3d5529a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.637955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b5a-8bc8-4d2c-b943-274d3d5529a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.638232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b5a-8bc8-4d2c-b943-274d3d5529a7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.639430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4b5a-8bc8-4d2c-b943-274d3d5529a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:12.641280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4b5a-8bc8-4d2c-b943-274d3d5529a7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:12.643113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:12.649228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46060920-a906-4341-bdec-83d965717a69 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:12.659576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46060920-a906-4341-bdec-83d965717a69 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:12.664303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed21bb-ed7d-47ef-ba5e-f05253be535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:12.664978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed21bb-ed7d-47ef-ba5e-f05253be535d admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:12.665272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed21bb-ed7d-47ef-ba5e-f05253be535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:12.665595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed21bb-ed7d-47ef-ba5e-f05253be535d admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:12.666352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed21bb-ed7d-47ef-ba5e-f05253be535d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:12.667363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-43ed21bb-ed7d-47ef-ba5e-f05253be535d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:12.667363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:12.667363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:12.668581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed21bb-ed7d-47ef-ba5e-f05253be535d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:12.703719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 29/56] 10.222.0.48 () {60 vars in 1161 bytes} [Tue Oct 12 16:35:12 2021] POST /identity/v3/projects => generated 298 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:15.029417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e2cc-e8f3-41a2-8def-ee986d19b28c None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:15.029993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e2cc-e8f3-41a2-8def-ee986d19b28c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:15.029993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102e2cc-e8f3-41a2-8def-ee986d19b28c None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:15.032350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 28/57] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:15.038762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112afb-c243-44f7-a224-428f3afb3c43 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:15.039198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112afb-c243-44f7-a224-428f3afb3c43 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:15.039333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112afb-c243-44f7-a224-428f3afb3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:15.065680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-58112afb-c243-44f7-a224-428f3afb3c43 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:15.067421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-58112afb-c243-44f7-a224-428f3afb3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:15.129506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 30/58] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:15.157126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e2cc-e8f3-41a2-8def-ee986d19b28c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:15.173344 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102e2cc-e8f3-41a2-8def-ee986d19b28c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:15.179484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d52b-789d-4e23-b9a6-40225addfc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:15.180285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d52b-789d-4e23-b9a6-40225addfc9e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:15.180570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d52b-789d-4e23-b9a6-40225addfc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:15.180868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d52b-789d-4e23-b9a6-40225addfc9e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:15.182147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d52b-789d-4e23-b9a6-40225addfc9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:15.184223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d52b-789d-4e23-b9a6-40225addfc9e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:15.186039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:15.193060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58112afb-c243-44f7-a224-428f3afb3c43 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:15.205346 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58112afb-c243-44f7-a224-428f3afb3c43 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:15.211807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1d4c-2de1-49e2-b8f4-706000cbf4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:15.212646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1d4c-2de1-49e2-b8f4-706000cbf4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:15.212888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1d4c-2de1-49e2-b8f4-706000cbf4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:15.213330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1d4c-2de1-49e2-b8f4-706000cbf4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:15.214711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1d4c-2de1-49e2-b8f4-706000cbf4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:15.215749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-489c1d4c-2de1-49e2-b8f4-706000cbf4a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:15.215749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:15.215749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:15.217097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1d4c-2de1-49e2-b8f4-706000cbf4a1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:15.247575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 31/60] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:35:15 2021] POST /identity/v3/users => generated 275 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:19.586312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f410-b96e-4e4b-acbc-566bedf32cf7 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.587197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f410-b96e-4e4b-acbc-566bedf32cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.587335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f410-b96e-4e4b-acbc-566bedf32cf7 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.590806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 30/61] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:19 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:19.598505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9ddc6-282e-48ea-9f01-9f89adb00138 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.599351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9ddc6-282e-48ea-9f01-9f89adb00138 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.599663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9ddc6-282e-48ea-9f01-9f89adb00138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.638215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2ab9ddc6-282e-48ea-9f01-9f89adb00138 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:19.640090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2ab9ddc6-282e-48ea-9f01-9f89adb00138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:19.660404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 32/62] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:19.697713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346f410-b96e-4e4b-acbc-566bedf32cf7 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:19.721263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346f410-b96e-4e4b-acbc-566bedf32cf7 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:19.737037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:19.738939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.739726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.740482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.761209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:19.763833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f68eb-ab22-4806-be9a-da1425682d5f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.764609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f68eb-ab22-4806-be9a-da1425682d5f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.765348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f68eb-ab22-4806-be9a-da1425682d5f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.768685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:19.770076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 33/63] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:19 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:19.770521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 31/64] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:19.776581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb16e-b7ae-4a04-b266-8c7204094435 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.776983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:19.777424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb16e-b7ae-4a04-b266-8c7204094435 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.777923 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb16e-b7ae-4a04-b266-8c7204094435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.793167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078f083-4bb5-4d86-8fb9-91a214355c3b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:19.809240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:19.810342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.810850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.811342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.812329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] RBAC: Adding query filter params (name=member) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:19.812861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:19.814794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:19.817700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-33bcb16e-b7ae-4a04-b266-8c7204094435 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:19.820597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-33bcb16e-b7ae-4a04-b266-8c7204094435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:19.838129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 32/65] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:19.840095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:19.841823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:19.859241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd045-a6c7-4d0d-b57e-33e73ddb18db None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.860147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd045-a6c7-4d0d-b57e-33e73ddb18db None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.860913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd045-a6c7-4d0d-b57e-33e73ddb18db None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.861896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f587-a8c8-4a65-9b82-83d1e0844aac admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:19.865010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 35/67] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:19 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:19.871510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fd045-a6c7-4d0d-b57e-33e73ddb18db None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:19.873354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9c084-b6a5-433e-8f95-72df062ca494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:19.874413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9c084-b6a5-433e-8f95-72df062ca494 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.874712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9c084-b6a5-433e-8f95-72df062ca494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.874989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9c084-b6a5-433e-8f95-72df062ca494 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.886310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fd045-a6c7-4d0d-b57e-33e73ddb18db None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:19.892379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:19.893502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.893788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.894249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.894447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9c084-b6a5-433e-8f95-72df062ca494 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:19.896764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9c084-b6a5-433e-8f95-72df062ca494 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:19.898970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 33/68] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:19.900283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f51c5-f976-4750-b767-567cfe06ac65 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.900600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f51c5-f976-4750-b767-567cfe06ac65 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.900865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f51c5-f976-4750-b767-567cfe06ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.907598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:19.917042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:19.918552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 36/69] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:19.924473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:19.931453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e86f51c5-f976-4750-b767-567cfe06ac65 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:19.933017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e86f51c5-f976-4750-b767-567cfe06ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:19.933152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972162c-1fb0-4b0a-9acf-f0ef76f74572 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:19.938647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:19.940240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.940972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.941655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.943097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 34/70] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:19.944358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f51c5-f976-4750-b767-567cfe06ac65 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:19.955318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f51c5-f976-4750-b767-567cfe06ac65 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:19.966648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:19.967715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:19.968656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:19.970717 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:19.971184 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:19.971625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:19.972565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:19.973221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:19.979201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:19.989893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 37/71] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:19.990765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:19.995773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 35/72] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:19.997338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.008349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0b5dc-9b74-4d7a-b68c-0f6fca3aa4ee admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.012445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e67b7-f163-4a05-b7bf-d876df71880d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.014165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.015591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.016159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.016775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.018480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.019025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.019632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.020087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.020520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.021830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.029007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:20.030273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.034294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:20.040730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7323b-72f2-4e38-9dd5-6b1ddf89e98b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.043504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:20.045233 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:20.045793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.046198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.047254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.047822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.048345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.049841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.052550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.055105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.056486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.068755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a5e17-4985-42b0-b04b-38cec0bd04a2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.074414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.075092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.075386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.075679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.076585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03baa6-a521-4b18-b37d-422edc86aece admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.084128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.085680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.085838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.086665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.087448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.087633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.089156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:20.089794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.092397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.099006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 39/76] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:20.100110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.114363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453be8-76ac-44f4-9e51-a200a9dcdac8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.114857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 38/77] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.116139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.129346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1d377-0fc8-41cb-8062-fab4cb616afa admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.131445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.132805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.133470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.133989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.135675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.135823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] RBAC: Adding query filter params (role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=3b38fac5719442ec8d74d1de558e09b0, user.id=13ec4053378f47b487500f3d2da70432) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:20.136327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.137148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.137672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.138296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.140101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.140218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.143109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.145117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.146235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.158878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28fdb3-932e-4003-a973-49217c6b1bf5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.159080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/role_assignments?user.id=13ec4053378f47b487500f3d2da70432&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.160456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.173338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.174633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.175156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.175638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.178522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.182079 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.184397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 40/80] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.187074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67ab6-bdd7-440c-9b64-9cdc8971cf77 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.192822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.193923 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.195581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.201147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.201950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.203112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] RBAC: Adding query filter params (role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=3b38fac5719442ec8d74d1de558e09b0, user.id=13ec4053378f47b487500f3d2da70432) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:20.205431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.208812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.213492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265563-fa9a-488c-ae36-5b62bef81ace admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.219939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 41/81] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/role_assignments?user.id=13ec4053378f47b487500f3d2da70432&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 259 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.223239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.224181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.224680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.225213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.235742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.238000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.248703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 41/82] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:35:20.259701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.271504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bfd9f-d34a-4103-b247-4c1e8024ad1b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.282047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47838c4-37c2-421c-adc8-21f24172b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.283341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47838c4-37c2-421c-adc8-21f24172b5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.283863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47838c4-37c2-421c-adc8-21f24172b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.284376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47838c4-37c2-421c-adc8-21f24172b5fc admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.286029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47838c4-37c2-421c-adc8-21f24172b5fc admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.288510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47838c4-37c2-421c-adc8-21f24172b5fc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.290783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.302601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.320587 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f4f49-be37-45c4-91e0-c563137fc451 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.330364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf6850-efab-4ee6-adfe-d643725ed434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.331441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6850-efab-4ee6-adfe-d643725ed434 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.331937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6850-efab-4ee6-adfe-d643725ed434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.332415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf6850-efab-4ee6-adfe-d643725ed434 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.333572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf6850-efab-4ee6-adfe-d643725ed434 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=3b38fac5719442ec8d74d1de558e09b0, user.id=d4d408e2598343a193d18277dfdc0252) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:20.334428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf6850-efab-4ee6-adfe-d643725ed434 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.338288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf6850-efab-4ee6-adfe-d643725ed434 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.348837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 42/84] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/role_assignments?user.id=d4d408e2598343a193d18277dfdc0252&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.605317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405138b-943c-4529-beb6-e732dbe2b534 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.606963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405138b-943c-4529-beb6-e732dbe2b534 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.607825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405138b-943c-4529-beb6-e732dbe2b534 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.610525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 43/85] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:20.619435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f799a9-1abe-45b1-89fe-ab6de55f5bb8 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.620492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f799a9-1abe-45b1-89fe-ab6de55f5bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.620997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f799a9-1abe-45b1-89fe-ab6de55f5bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.649167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-53f799a9-1abe-45b1-89fe-ab6de55f5bb8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:20.651843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-53f799a9-1abe-45b1-89fe-ab6de55f5bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:20.669574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 43/86] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:20.710180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405138b-943c-4529-beb6-e732dbe2b534 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.733351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405138b-943c-4529-beb6-e732dbe2b534 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.740555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a90a5e-0241-4676-8225-c9b1047aac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.741499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a90a5e-0241-4676-8225-c9b1047aac04 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.741794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a90a5e-0241-4676-8225-c9b1047aac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.742084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a90a5e-0241-4676-8225-c9b1047aac04 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.743965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a90a5e-0241-4676-8225-c9b1047aac04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.747198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a90a5e-0241-4676-8225-c9b1047aac04 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.750302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:20.759565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f799a9-1abe-45b1-89fe-ab6de55f5bb8 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:20.772676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f799a9-1abe-45b1-89fe-ab6de55f5bb8 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:20.780575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:20.781629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.782129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.783182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.784306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:20.787505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:20.834472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083318-246a-4654-930b-52894a86b907 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.834963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083318-246a-4654-930b-52894a86b907 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.835253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083318-246a-4654-930b-52894a86b907 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.837648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 45/88] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:20.848820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a101-0e3a-45cf-838d-20b30ebd37d8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:20.849338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a101-0e3a-45cf-838d-20b30ebd37d8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:20.849873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739a101-0e3a-45cf-838d-20b30ebd37d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:20.857065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 44/89] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:35:20 2021] POST /identity/v3/projects => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:20.876893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4739a101-0e3a-45cf-838d-20b30ebd37d8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:20.878348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4739a101-0e3a-45cf-838d-20b30ebd37d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:21.002466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 46/90] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:21.041878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:21.059450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220dcad-7f8e-48e3-b0d0-b77d3aa58af6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:21.070318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:21.071522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:21.071835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:21.072170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:21.096640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:21.109193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:21.110663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 45/91] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:21.118849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739a101-0e3a-45cf-838d-20b30ebd37d8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:21.136094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739a101-0e3a-45cf-838d-20b30ebd37d8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:21.146638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:21.147318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:21.147606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:21.147884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:21.148667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:21.148977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:21.150662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:21.165181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 47/92] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:21.171301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:21.183268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c43a0-544a-4ffd-a6a0-ef3eb9c3a7a6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:21.188230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:21.189512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:21.190025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:21.190495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:21.192088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:21.195492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:21.197703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 46/93] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:21 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:21.206390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:21.219327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c690b9c-b56d-4903-bd31-c789c9908c64 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:21.224905 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:21.225910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:21.226473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:21.226953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:21.237271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:21.239473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:21.249568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 48/94] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:21.258181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:21.275118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f37741-802a-431f-a3b1-dcf9cc65a988 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:21.280196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc53f2b-c039-48b3-a22a-b169562750c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:21.281462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53f2b-c039-48b3-a22a-b169562750c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:21.281954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53f2b-c039-48b3-a22a-b169562750c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:21.282464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc53f2b-c039-48b3-a22a-b169562750c9 admin admin] PATH_INFO: `/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:21.284618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53f2b-c039-48b3-a22a-b169562750c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5cfeca2ec7b44c4e9ec8776849dbd884)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:21.287180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc53f2b-c039-48b3-a22a-b169562750c9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:21.289602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 47/95] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:21 2021] GET /identity/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884 => generated 312 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:21.295659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:21.305919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e8b18-0e15-4f68-a45d-de35b2727206 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:21.315466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ee89d-71de-4836-97fa-4e7f3622ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:21.316460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee89d-71de-4836-97fa-4e7f3622ee31 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:21.317132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee89d-71de-4836-97fa-4e7f3622ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:21.317657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ee89d-71de-4836-97fa-4e7f3622ee31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:21.318763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee89d-71de-4836-97fa-4e7f3622ee31 admin admin] RBAC: Adding query filter params (role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=5cfeca2ec7b44c4e9ec8776849dbd884, user.id=13ec4053378f47b487500f3d2da70432) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:21.319300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee89d-71de-4836-97fa-4e7f3622ee31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:21.321679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ee89d-71de-4836-97fa-4e7f3622ee31 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:21.328012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:21 2021] GET /identity/v3/role_assignments?user.id=13ec4053378f47b487500f3d2da70432&scope.project.id=5cfeca2ec7b44c4e9ec8776849dbd884&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.532216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae84e8-9675-464f-b524-c1cd2ebdb809 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.533103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae84e8-9675-464f-b524-c1cd2ebdb809 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.533559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae84e8-9675-464f-b524-c1cd2ebdb809 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.536212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 48/97] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:23.542153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033524-935d-4ff8-94b8-603905ab0e5e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.542989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033524-935d-4ff8-94b8-603905ab0e5e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.543418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033524-935d-4ff8-94b8-603905ab0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.547217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a68dc-e366-40d5-b931-6f131324ce60 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.547737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a68dc-e366-40d5-b931-6f131324ce60 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.548196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a68dc-e366-40d5-b931-6f131324ce60 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.550728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 49/98] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:23.556531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286241-eb46-4b23-b527-f2a6f3e0f3c9 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.557048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286241-eb46-4b23-b527-f2a6f3e0f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.557540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286241-eb46-4b23-b527-f2a6f3e0f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.586614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3d033524-935d-4ff8-94b8-603905ab0e5e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:23.587177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-89286241-eb46-4b23-b527-f2a6f3e0f3c9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:23.587892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3d033524-935d-4ff8-94b8-603905ab0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:23.588841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-89286241-eb46-4b23-b527-f2a6f3e0f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:23.597803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:23.600814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 50/100] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:23.620640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9a395-3d40-43e9-b51e-795125880abe None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.620938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9a395-3d40-43e9-b51e-795125880abe None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.621216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9a395-3d40-43e9-b51e-795125880abe None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.621549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033524-935d-4ff8-94b8-603905ab0e5e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.623469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 51/101] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:23.631474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515abec-a00e-4f9e-933c-913aae394fe2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.632048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515abec-a00e-4f9e-933c-913aae394fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.632511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515abec-a00e-4f9e-933c-913aae394fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.635807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033524-935d-4ff8-94b8-603905ab0e5e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.640417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.641212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.641534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.641821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.652625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:23.653789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1515abec-a00e-4f9e-933c-913aae394fe2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:23.655199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1515abec-a00e-4f9e-933c-913aae394fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:23.659517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:23.661205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:23.662189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.667605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 52/103] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:23.668870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515abec-a00e-4f9e-933c-913aae394fe2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.680059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515abec-a00e-4f9e-933c-913aae394fe2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.683839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408115-9b1a-4861-98ec-940b8fdbbd54 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.685333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.686251 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.686740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.687194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.688140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:23.688636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.691244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.699650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.700722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.701777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.702243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.704684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 53/104] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.706052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.716920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5cdf-d9e5-46c3-a815-eaf4fb2da276 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.721244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:23.723068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.724369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.724791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.725179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.730163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:23.731818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 52/105] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:23.732780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.736654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:23.743303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10964cf5-1572-4938-a3a7-785a56426920 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.745760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:23.747217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 54/106] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:23.748348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.750059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b9849-04de-45a1-a31d-70481c653a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.751161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9849-04de-45a1-a31d-70481c653a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.751651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9849-04de-45a1-a31d-70481c653a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.752158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b9849-04de-45a1-a31d-70481c653a01 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.753682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b9849-04de-45a1-a31d-70481c653a01 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.755905 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b9849-04de-45a1-a31d-70481c653a01 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.757587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 53/107] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.758804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c41d4-32eb-454c-96fe-d1303b564692 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.759100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c41d4-32eb-454c-96fe-d1303b564692 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.759389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c41d4-32eb-454c-96fe-d1303b564692 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.760152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269f6f2-4ba9-4a03-a6f3-7fd279b16856 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.765519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 54/108] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:23 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:23.766517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c41d4-32eb-454c-96fe-d1303b564692 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.769177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.769899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.770191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.770476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.771257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:23.771574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.773208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.778417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c41d4-32eb-454c-96fe-d1303b564692 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.782530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 55/109] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.783619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.786360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf3455-415d-43cf-9528-54b004f2c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.787308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf3455-415d-43cf-9528-54b004f2c893 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.787819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf3455-415d-43cf-9528-54b004f2c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.788639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf3455-415d-43cf-9528-54b004f2c893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.790037 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf3455-415d-43cf-9528-54b004f2c893 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:23.790364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf3455-415d-43cf-9528-54b004f2c893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.792346 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf3455-415d-43cf-9528-54b004f2c893 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.793070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3324a-f558-44c5-ab27-e8b8dba78963 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.797969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.799884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.800344 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.800727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.802097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.803384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 55/110] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.804004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.804747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba554158-2cfa-498d-84b8-560ea33e91a8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.805048 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba554158-2cfa-498d-84b8-560ea33e91a8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.805332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba554158-2cfa-498d-84b8-560ea33e91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.805863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 56/111] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.811567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.816190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15765343-4d0e-4f2b-bf59-5b8fe2096aa3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.821147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.822267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.824870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.824870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.824870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.826200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.828035 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 57/112] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.833145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.833356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ba554158-2cfa-498d-84b8-560ea33e91a8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:23.833356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ba554158-2cfa-498d-84b8-560ea33e91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:23.839094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27707642-2fe7-434c-8370-785f3756f1ec admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.842974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 56/113] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:23.843942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba554158-2cfa-498d-84b8-560ea33e91a8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.844260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.845339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.846387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.846858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.848343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.851252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.853394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 58/114] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.854183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba554158-2cfa-498d-84b8-560ea33e91a8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.854586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.862113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.862113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.862113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.862113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0/users/13ec4053378f47b487500f3d2da70432/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.863600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b38fac5719442ec8d74d1de558e09b0, user_id=13ec4053378f47b487500f3d2da70432, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.864712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:23.864712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:23.864712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:23.866821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.872638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092950c-ad17-4099-9f56-ac1a01951a54 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.878364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.879304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.879688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.880053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.881315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.882753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 57/115] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:23 2021] PUT /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0/users/13ec4053378f47b487500f3d2da70432/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:23.883507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.883646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.885632 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 59/116] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.886379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.897584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468a41a-3257-46c9-87a7-4c22212664f9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.958171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5df9cf-cf66-470d-8663-04edc5929075 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.962278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.963778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.964300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.964566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.965045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.965245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.965555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.965841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.967203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.967852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.969640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.970249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.972041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 58/117] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.972942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.978454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 60/118] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:23.979659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:23.983953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40030461-00d3-4194-97d5-4692a58b05d0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.991344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.991756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc907-92fd-4c9d-b3b9-d75e72e7267e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:23.992573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.992990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.993410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0/users/13ec4053378f47b487500f3d2da70432/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:23.995940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b38fac5719442ec8d74d1de558e09b0, user_id=13ec4053378f47b487500f3d2da70432, role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:23.997771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea84cd-2f5b-42ad-8f1e-645aa019ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:23.998848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea84cd-2f5b-42ad-8f1e-645aa019ea28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:23.999078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:23.999453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea84cd-2f5b-42ad-8f1e-645aa019ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:23.999877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea84cd-2f5b-42ad-8f1e-645aa019ea28 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0/users/d4d408e2598343a193d18277dfdc0252/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.002836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea84cd-2f5b-42ad-8f1e-645aa019ea28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b38fac5719442ec8d74d1de558e09b0, user_id=d4d408e2598343a193d18277dfdc0252, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:24.006248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea84cd-2f5b-42ad-8f1e-645aa019ea28 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:24.016819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 59/119] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:23 2021] PUT /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0/users/13ec4053378f47b487500f3d2da70432/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:24.017892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:24.023811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 61/120] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:23 2021] PUT /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0/users/d4d408e2598343a193d18277dfdc0252/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:24.143860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ef10-8c9e-44fb-8e51-a75b3cd3189d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:24.224246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df0a9-112c-4d32-9e53-e2c3f375f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:24.224975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df0a9-112c-4d32-9e53-e2c3f375f3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.225310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df0a9-112c-4d32-9e53-e2c3f375f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.225692 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df0a9-112c-4d32-9e53-e2c3f375f3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.226473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df0a9-112c-4d32-9e53-e2c3f375f3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:24.228532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df0a9-112c-4d32-9e53-e2c3f375f3a0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:24.254373 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 60/121] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:35:24 2021] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:24.552605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be5fd-47cb-4b97-8fcc-91002c49b5fe None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.552605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be5fd-47cb-4b97-8fcc-91002c49b5fe None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.552605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769be5fd-47cb-4b97-8fcc-91002c49b5fe None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.552605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 62/122] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:24.561056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19872cde-9fb8-412b-9d83-07c87876260f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.561514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19872cde-9fb8-412b-9d83-07c87876260f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.561727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19872cde-9fb8-412b-9d83-07c87876260f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.582304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-19872cde-9fb8-412b-9d83-07c87876260f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:24.583525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-19872cde-9fb8-412b-9d83-07c87876260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:24.596593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 61/123] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:24.621576 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be5fd-47cb-4b97-8fcc-91002c49b5fe None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:24.637567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769be5fd-47cb-4b97-8fcc-91002c49b5fe None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:24.642942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:24.643934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.644370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.644796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.656100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:24.663854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:24.665245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 63/124] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:24.671814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19872cde-9fb8-412b-9d83-07c87876260f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:24.682021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19872cde-9fb8-412b-9d83-07c87876260f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:24.686802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:24.687640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.688116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.688546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.689547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:24.690006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:24.691788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:24.701243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 62/125] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:24.707616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:24.718437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef4b0-d029-428a-b4c1-1e1106912854 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:24.723871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:24.724900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.725356 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.725825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.727533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:24.730828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:24.732807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 64/126] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:24 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:24.740475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:24.750706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e27c2-1cc5-4187-87ea-932759560e91 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:24.755583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7e315-1761-45d5-a959-61c31c39ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:24.756643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e315-1761-45d5-a959-61c31c39ea0b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.757135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e315-1761-45d5-a959-61c31c39ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.757644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7e315-1761-45d5-a959-61c31c39ea0b admin admin] PATH_INFO: `/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.759104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e315-1761-45d5-a959-61c31c39ea0b admin admin] RBAC: Authorizing `identity:get_project(project_id=5cfeca2ec7b44c4e9ec8776849dbd884)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:24.761568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7e315-1761-45d5-a959-61c31c39ea0b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:24.763818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 63/127] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:24 2021] GET /identity/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:24.770491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:24.780668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e2b6b-ac32-45ff-bc11-8772c437b1c5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:24.787082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a22b5-5cd7-4c7c-b8d7-3e6b9737ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:24.788142 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a22b5-5cd7-4c7c-b8d7-3e6b9737ab40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:24.788578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a22b5-5cd7-4c7c-b8d7-3e6b9737ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:24.789009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a22b5-5cd7-4c7c-b8d7-3e6b9737ab40 admin admin] PATH_INFO: `/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884/users/13ec4053378f47b487500f3d2da70432/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:24.791244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a22b5-5cd7-4c7c-b8d7-3e6b9737ab40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfeca2ec7b44c4e9ec8776849dbd884, user_id=13ec4053378f47b487500f3d2da70432, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:24.794281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a22b5-5cd7-4c7c-b8d7-3e6b9737ab40 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:24.815114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 65/128] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:24 2021] PUT /identity/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884/users/13ec4053378f47b487500f3d2da70432/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:27.110096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07eee6-2a06-4ba8-9c4c-9733ec633334 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.110601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07eee6-2a06-4ba8-9c4c-9733ec633334 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.110669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07eee6-2a06-4ba8-9c4c-9733ec633334 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.112717 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 64/129] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:27.119151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ccf6d-2c4f-4607-af9b-69063b458810 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.119593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ccf6d-2c4f-4607-af9b-69063b458810 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.119809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ccf6d-2c4f-4607-af9b-69063b458810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.142456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a91ccf6d-2c4f-4607-af9b-69063b458810 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:27.144164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a91ccf6d-2c4f-4607-af9b-69063b458810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:27.228728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 66/130] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:27.270322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07eee6-2a06-4ba8-9c4c-9733ec633334 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.283189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7065-639c-46a8-8687-ffa21aacd320 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.283491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7065-639c-46a8-8687-ffa21aacd320 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.284393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d7065-639c-46a8-8687-ffa21aacd320 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.286997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 67/131] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:27 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:27.291705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07eee6-2a06-4ba8-9c4c-9733ec633334 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.293750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7ae1e-1a97-48d6-9fee-8fc4f2c29780 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.294046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7ae1e-1a97-48d6-9fee-8fc4f2c29780 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.294334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7ae1e-1a97-48d6-9fee-8fc4f2c29780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.300815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.301696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.301997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.302322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.328840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:27.337251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:27.341803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-4fe7ae1e-1a97-48d6-9fee-8fc4f2c29780 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:27.343032 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4fe7ae1e-1a97-48d6-9fee-8fc4f2c29780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:27.345128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 65/132] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:27.352926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.363367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 68/133] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:27.368221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff7f65-1790-4dcc-b4da-90be42782c2c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.377508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.378185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.378480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.378770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.379557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:27.379992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.381665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.390931 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 66/134] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:27.398212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7ae1e-1a97-48d6-9fee-8fc4f2c29780 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.408028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7ae1e-1a97-48d6-9fee-8fc4f2c29780 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.409707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.426310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.427230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.427569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.427888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.429754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.431980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.433686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 69/135] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:27.436170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807fbc4-8437-4327-9e5e-a98572e04b65 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.441323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.449651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e30df-a278-4864-a96e-299a662e6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.450466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e30df-a278-4864-a96e-299a662e6c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.450762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e30df-a278-4864-a96e-299a662e6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.451052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e30df-a278-4864-a96e-299a662e6c45 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.467021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87aace8-8492-4ea7-914f-fb6f32d2dea8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.476497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e30df-a278-4864-a96e-299a662e6c45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:27.483550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-729e30df-a278-4864-a96e-299a662e6c45 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:27.484961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 67/136] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:27.486349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3384-3c3e-4d6e-86c4-885c1f5a7628 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.486647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3384-3c3e-4d6e-86c4-885c1f5a7628 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.486996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d3384-3c3e-4d6e-86c4-885c1f5a7628 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.487939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ef38-bebe-4997-8ffe-a1dab8edd3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.488612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ef38-bebe-4997-8ffe-a1dab8edd3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.488903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ef38-bebe-4997-8ffe-a1dab8edd3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.489190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ef38-bebe-4997-8ffe-a1dab8edd3f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.489474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 68/137] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:27.495044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d3384-3c3e-4d6e-86c4-885c1f5a7628 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.507647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ef38-bebe-4997-8ffe-a1dab8edd3f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.509477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ef38-bebe-4997-8ffe-a1dab8edd3f0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.516959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d3384-3c3e-4d6e-86c4-885c1f5a7628 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.524994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.525648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.526041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.526327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.527169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:27.527484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.529164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.532482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:27.534896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ec441-a24d-48de-8e93-89b2c7e44a24 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.535193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ec441-a24d-48de-8e93-89b2c7e44a24 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.535480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ec441-a24d-48de-8e93-89b2c7e44a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.540749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 69/139] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:27.542491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.559952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe9b70-59f5-4a1a-acdf-9aa7e129fbc6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.573999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.574357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-fe3ec441-a24d-48de-8e93-89b2c7e44a24 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:27.575526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.575628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fe3ec441-a24d-48de-8e93-89b2c7e44a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:27.576112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.576583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.578072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.580653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.583671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 70/140] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:27.584696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.595638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 71/141] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:27.596596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ec441-a24d-48de-8e93-89b2c7e44a24 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.601319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a5c7-04e7-40df-8278-7b41a22323d7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.612956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ec441-a24d-48de-8e93-89b2c7e44a24 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.613745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.614860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.615341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.615831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.622100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.624198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.626073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 71/142] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:27.626920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.628197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.628487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.628769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.629659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] RBAC: Adding query filter params (role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=3b38fac5719442ec8d74d1de558e09b0, user.id=13ec4053378f47b487500f3d2da70432) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:27.629981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.631962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.633030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.638577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 72/143] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/role_assignments?user.id=13ec4053378f47b487500f3d2da70432&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:27.647630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833051f-0175-4ffb-93c1-89e548cd35aa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.649527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.659314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.660348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.660815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.661268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.663408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e0d2e-d49e-432b-b4cd-64746a178704 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.677884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.678323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.679240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.679598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.679956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.680901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.696368 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 72/144] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:27.703787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.706468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:27.715300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:27.716727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 73/145] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:27.717903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6bfc3-aaa0-49c1-abc2-ff73e26dacf3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.723300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.730890 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.732084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.732543 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.732991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.738250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.739235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f5a4-6d85-4b21-a334-5db525deb3b3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.741190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.743200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 73/146] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:27.750007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.750908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.751687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.752051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.752928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.753843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:27.754230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.756018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.766620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1862a49-ada6-4ca7-9dbd-2aee57e0eb32 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.774060 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 74/147] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:27.780780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.783390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.784321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.784783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.785235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.786456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=3b38fac5719442ec8d74d1de558e09b0, user.id=d4d408e2598343a193d18277dfdc0252) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:27.786951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.789028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.797358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8a0b-da4e-4729-baa1-d4ef9c2d15c7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.800522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 74/148] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/role_assignments?user.id=d4d408e2598343a193d18277dfdc0252&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:27.814177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.815831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.816135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.816422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.818128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.820387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.822488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 75/149] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:27.829391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.846809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89630cf4-a496-4f47-8fcd-4e0f2db8dfa5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.862811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.863496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.863875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.864164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.873481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.875306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.890935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 75/150] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:27.897573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.910802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272923f-d87c-400f-a488-c24e0307a9c8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.921994 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807fced-6879-418b-9ebc-1ec28e3045a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.922902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807fced-6879-418b-9ebc-1ec28e3045a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.923191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807fced-6879-418b-9ebc-1ec28e3045a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.923476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807fced-6879-418b-9ebc-1ec28e3045a2 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.930447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807fced-6879-418b-9ebc-1ec28e3045a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.932588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807fced-6879-418b-9ebc-1ec28e3045a2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.934832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 76/151] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:27.942162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:27.955019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f48064-968a-4953-a105-c825c9a868bd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:27.964823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648a187-2e74-4f28-ac16-f223e1d042bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:27.965531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a187-2e74-4f28-ac16-f223e1d042bb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:27.965822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a187-2e74-4f28-ac16-f223e1d042bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:27.966103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a187-2e74-4f28-ac16-f223e1d042bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:27.966969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648a187-2e74-4f28-ac16-f223e1d042bb admin admin] RBAC: Adding query filter params (role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=3b38fac5719442ec8d74d1de558e09b0, user.id=13ec4053378f47b487500f3d2da70432) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:27.967287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648a187-2e74-4f28-ac16-f223e1d042bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:27.969209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648a187-2e74-4f28-ac16-f223e1d042bb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:27.978606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 76/152] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:27 2021] GET /identity/v3/role_assignments?user.id=13ec4053378f47b487500f3d2da70432&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:28.768075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a0e7-4226-4808-a2a9-f57b542fdb54 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:28.769119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a0e7-4226-4808-a2a9-f57b542fdb54 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:28.769190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474a0e7-4226-4808-a2a9-f57b542fdb54 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:28.771349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 77/153] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:28.778859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa32b8f-1d79-4ef1-acc9-199a3ea40f2d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:28.779315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa32b8f-1d79-4ef1-acc9-199a3ea40f2d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:28.779512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa32b8f-1d79-4ef1-acc9-199a3ea40f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:28.801086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8aa32b8f-1d79-4ef1-acc9-199a3ea40f2d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:28.802362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8aa32b8f-1d79-4ef1-acc9-199a3ea40f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:28.818876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 77/154] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:28.867803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a0e7-4226-4808-a2a9-f57b542fdb54 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:28.883420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8141537-adc3-4fed-aa18-b95be7ee342e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:28.883719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8141537-adc3-4fed-aa18-b95be7ee342e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:28.883988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8141537-adc3-4fed-aa18-b95be7ee342e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:28.885973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 78/155] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:28.888279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474a0e7-4226-4808-a2a9-f57b542fdb54 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:28.892190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247e045-7b78-4cb9-b370-a34986ec798d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:28.892481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247e045-7b78-4cb9-b370-a34986ec798d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:28.892761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247e045-7b78-4cb9-b370-a34986ec798d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:28.900656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:28.901477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:28.901767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:28.902046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:28.930466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e247e045-7b78-4cb9-b370-a34986ec798d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:28.931687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e247e045-7b78-4cb9-b370-a34986ec798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:28.933433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:28.940866 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:28.942385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 78/156] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:28.949458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:28.960663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 79/157] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:28.973996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb6171-35af-4513-9d56-2e144c31eb8d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:28.982654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:28.983339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:28.983630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:28.983914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:28.984693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:28.985003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:28.986910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247e045-7b78-4cb9-b370-a34986ec798d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:28.994531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:28.996164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247e045-7b78-4cb9-b370-a34986ec798d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.006812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 79/158] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:28 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.013295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.018071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.020682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.020682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.020682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.030447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294aaf9-fe7d-41e1-be5e-49fc27b98fb4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.040884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:29.041802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.042928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.050113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:29.050635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.051113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] PATH_INFO: `/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.059555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 80/159] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:28 2021] GET /identity/v3/roles/member => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:29.067084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.078413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5e8ad-3189-4429-9f12-22e14d4255ed admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.079441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] RBAC: Authorizing `identity:get_user(user_id=a27299ef7f5a4c83bafcf85db2ea4e0f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.082241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.085225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 80/160] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f => generated 283 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.092349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.099536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.100215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.100497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.100772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.101570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:29.101879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.103508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.113686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ce38f-6e04-462a-b8f9-5013e71a390c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.119538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 81/161] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.123493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.124166 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.124450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.124727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.126168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.136758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f63a4-e59b-4626-a7e7-905c2066aff0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.142887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.146653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.147572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.147850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.148124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.148933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.152023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.156535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.161087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 82/162] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.169771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 81/163] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:29.171562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.177338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.187825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940076d2-2c9e-4cfd-914a-aaf815a472a8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.191522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fb225-d131-44f2-8383-a7dfe561e25e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.197580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.198281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.198566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.198841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.203434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.205615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.206478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.206924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.210101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.214023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.216054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 82/164] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.216857 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.218991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.224331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.236399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 83/165] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:29.238446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b054df2-4566-4ed5-a678-b0f8e8237e04 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.243245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.243947 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.244228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.244552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.245437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] RBAC: Adding query filter params (role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=d33cbbd3852e4283836762f9edd90a57, user.id=a27299ef7f5a4c83bafcf85db2ea4e0f) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:29.245751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.247670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.250801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.261643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0ec31-9c48-4eac-8d40-477829d80a1f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.266086 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 83/166] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/role_assignments?user.id=a27299ef7f5a4c83bafcf85db2ea4e0f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.269092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba827-6bb0-4135-b890-54eebeec7394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.270072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba827-6bb0-4135-b890-54eebeec7394 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.270676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba827-6bb0-4135-b890-54eebeec7394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.271065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba827-6bb0-4135-b890-54eebeec7394 admin admin] PATH_INFO: `/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.272516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aba827-6bb0-4135-b890-54eebeec7394 admin admin] RBAC: Authorizing `identity:get_project(project_id=5cfeca2ec7b44c4e9ec8776849dbd884)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.275092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aba827-6bb0-4135-b890-54eebeec7394 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.277466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 84/167] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.286587 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.303822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3fc51-a116-4cd6-bd2a-cea60ce8a25c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.309628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11996f-5ea9-4c5b-9ccc-624a187c1df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.310417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11996f-5ea9-4c5b-9ccc-624a187c1df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.310698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11996f-5ea9-4c5b-9ccc-624a187c1df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.310971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11996f-5ea9-4c5b-9ccc-624a187c1df2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.311895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11996f-5ea9-4c5b-9ccc-624a187c1df2 admin admin] RBAC: Adding query filter params (role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=5cfeca2ec7b44c4e9ec8776849dbd884, user.id=13ec4053378f47b487500f3d2da70432) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:29.312255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11996f-5ea9-4c5b-9ccc-624a187c1df2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.314231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11996f-5ea9-4c5b-9ccc-624a187c1df2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.326778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 84/168] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/role_assignments?user.id=13ec4053378f47b487500f3d2da70432&scope.project.id=5cfeca2ec7b44c4e9ec8776849dbd884&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.731281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dac2a-e8d7-47d4-a945-3848834bed59 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.731629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dac2a-e8d7-47d4-a945-3848834bed59 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.731797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dac2a-e8d7-47d4-a945-3848834bed59 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.733756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 85/169] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:29.743013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04525818-4015-4f56-9cbf-889cfed5d605 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.743013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04525818-4015-4f56-9cbf-889cfed5d605 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.743013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04525818-4015-4f56-9cbf-889cfed5d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.757064 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ee5f-392f-45fa-95d2-b8bf2e6e6332 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.757359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ee5f-392f-45fa-95d2-b8bf2e6e6332 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.759567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ee5f-392f-45fa-95d2-b8bf2e6e6332 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.759567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 86/170] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:29.762916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-04525818-4015-4f56-9cbf-889cfed5d605 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:29.764106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-04525818-4015-4f56-9cbf-889cfed5d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:29.766945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eea54-5ad7-4a70-bb8a-98329e50e028 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.767461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eea54-5ad7-4a70-bb8a-98329e50e028 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.767954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eea54-5ad7-4a70-bb8a-98329e50e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.776249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 85/171] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:29.797391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-840eea54-5ad7-4a70-bb8a-98329e50e028 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:29.799149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-840eea54-5ad7-4a70-bb8a-98329e50e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:29.803141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04525818-4015-4f56-9cbf-889cfed5d605 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.814668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 87/172] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:29.816884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04525818-4015-4f56-9cbf-889cfed5d605 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.822453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.823419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.823843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.824254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.835917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:29.841859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eea54-5ad7-4a70-bb8a-98329e50e028 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.843265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:29.844622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 86/173] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:29.856355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.857505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eea54-5ad7-4a70-bb8a-98329e50e028 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.861976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.863358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.863644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.863926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.868948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b1a2c-8eba-4542-a71f-771697f4a4be admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.874651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.874963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:29.875799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.876309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.876788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.877886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:29.878386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.880377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.882244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:29.883597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 88/174] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:29.889980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.894997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 87/175] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:29.902145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a931c-1306-47ec-b314-c2da92f6a549 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.902357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.907754 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.908665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.909739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.910224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.911192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:29.911744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.913145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80e25-2242-4f5e-92e0-26512448bc51 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.913841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.918352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.919441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.919890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.920385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.921819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.923946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.931219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 89/176] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:29.931723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 88/177] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.933109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.933645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.943041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5712-5b76-4b2d-bb89-6773ab253ae0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.946994 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa8a64-49a6-4d1c-98bb-977260e2fdf0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.951922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.952275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.952578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.952863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.953138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.954219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.954740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.955273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] PATH_INFO: `/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.956799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] RBAC: Authorizing `identity:get_user(user_id=a27299ef7f5a4c83bafcf85db2ea4e0f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.960697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.962135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:29.963424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 89/178] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:29.968270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:29.970488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.974234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 90/179] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:29.980815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:29.982790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5c6f1-f8dd-498f-8700-9dfb8d011241 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.989983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.990956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.991455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.991898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:29.991996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda5c43-00f3-4f05-a811-e2c1324f1574 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:29.997854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:29.998886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:29.999222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:29.999571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.001053 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:30.003433 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:30.004470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:30.005431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 91/180] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:30.007045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:30.016429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:30.017028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 90/181] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:35:30.023410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:30.031682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b42c40-2831-48c3-8a38-fcf43fa91131 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:30.032939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b6951-d0cd-4aae-ac55-29f051408f6e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:30.038245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171293-89d6-4f11-8c38-802392d48dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:30.039331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171293-89d6-4f11-8c38-802392d48dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:30.039457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:30.040009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171293-89d6-4f11-8c38-802392d48dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:30.040218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:30.040499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:30.040777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.041096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171293-89d6-4f11-8c38-802392d48dbc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.041999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:30.042493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171293-89d6-4f11-8c38-802392d48dbc admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=d33cbbd3852e4283836762f9edd90a57, user.id=d4d408e2598343a193d18277dfdc0252) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:30.043019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171293-89d6-4f11-8c38-802392d48dbc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:30.044097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:30.045410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171293-89d6-4f11-8c38-802392d48dbc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:30.049455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 91/182] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:30 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:30.053206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:30.056481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 92/183] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:30 2021] GET /identity/v3/role_assignments?user.id=d4d408e2598343a193d18277dfdc0252&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:30.067018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141249f-c402-43d1-896d-6d581bb3ff34 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:30.072950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5baf3f2-1c06-41ad-98f1-9f75f189c1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:30.073954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baf3f2-1c06-41ad-98f1-9f75f189c1ac admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:30.074428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baf3f2-1c06-41ad-98f1-9f75f189c1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:30.074883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5baf3f2-1c06-41ad-98f1-9f75f189c1ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.075925 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baf3f2-1c06-41ad-98f1-9f75f189c1ac admin admin] RBAC: Adding query filter params (role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=d33cbbd3852e4283836762f9edd90a57, user.id=a27299ef7f5a4c83bafcf85db2ea4e0f) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:30.076415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baf3f2-1c06-41ad-98f1-9f75f189c1ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:30.078602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5baf3f2-1c06-41ad-98f1-9f75f189c1ac admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:30.086428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 92/184] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:30 2021] GET /identity/v3/role_assignments?user.id=a27299ef7f5a4c83bafcf85db2ea4e0f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:30.146976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0936-22d5-4280-8e1f-c026cb2519c0 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:30.147278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0936-22d5-4280-8e1f-c026cb2519c0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:30.147545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0936-22d5-4280-8e1f-c026cb2519c0 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.149513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 93/185] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:30.156265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7c94f-42aa-4297-83bb-8886d67c679b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:30.156557 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7c94f-42aa-4297-83bb-8886d67c679b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:30.156841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7c94f-42aa-4297-83bb-8886d67c679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.177506 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-75e7c94f-42aa-4297-83bb-8886d67c679b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:30.178991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-75e7c94f-42aa-4297-83bb-8886d67c679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:30.187181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 93/186] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:30.213593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c0936-22d5-4280-8e1f-c026cb2519c0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:30.228174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c0936-22d5-4280-8e1f-c026cb2519c0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:30.233327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab3dcf-297d-4f08-b845-a6b1b29a1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:30.234204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab3dcf-297d-4f08-b845-a6b1b29a1a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:30.234551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab3dcf-297d-4f08-b845-a6b1b29a1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:30.234893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab3dcf-297d-4f08-b845-a6b1b29a1a7f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.236305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab3dcf-297d-4f08-b845-a6b1b29a1a7f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:30.238329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab3dcf-297d-4f08-b845-a6b1b29a1a7f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:30.240325 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 94/187] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:30.248096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7c94f-42aa-4297-83bb-8886d67c679b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:30.258555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7c94f-42aa-4297-83bb-8886d67c679b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:30.264093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba063f-2db3-44a0-8a23-f745b58c6002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:30.264972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba063f-2db3-44a0-8a23-f745b58c6002 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:30.265428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba063f-2db3-44a0-8a23-f745b58c6002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:30.265820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba063f-2db3-44a0-8a23-f745b58c6002 admin admin] PATH_INFO: `/v3/groups` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:30.266807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba063f-2db3-44a0-8a23-f745b58c6002 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:30.268150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-7bba063f-2db3-44a0-8a23-f745b58c6002 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:30.268150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:30.268150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:30.270331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba063f-2db3-44a0-8a23-f745b58c6002 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:30.293184 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 94/188] 10.222.0.48 () {60 vars in 1155 bytes} [Tue Oct 12 16:35:30 2021] POST /identity/v3/groups => generated 229 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:31.796900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ba62-7763-4b0a-afa1-7b15e7ff33cf None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:31.797513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ba62-7763-4b0a-afa1-7b15e7ff33cf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:31.797513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ba62-7763-4b0a-afa1-7b15e7ff33cf None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:31.799491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 95/189] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:31.807059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195752a6-5bc3-4b24-b1c9-8b445d5febf9 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:31.807558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195752a6-5bc3-4b24-b1c9-8b445d5febf9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:31.807705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195752a6-5bc3-4b24-b1c9-8b445d5febf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:31.826398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-195752a6-5bc3-4b24-b1c9-8b445d5febf9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:31.827620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-195752a6-5bc3-4b24-b1c9-8b445d5febf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:31.836465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 95/190] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:31.860050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87ba62-7763-4b0a-afa1-7b15e7ff33cf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:31.872733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87ba62-7763-4b0a-afa1-7b15e7ff33cf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:31.877357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:31.878195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:31.878482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:31.878757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:31.889814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:31.897390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:31.898945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 96/191] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:31.905314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195752a6-5bc3-4b24-b1c9-8b445d5febf9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:31.915299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195752a6-5bc3-4b24-b1c9-8b445d5febf9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:31.920170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:31.920847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:31.921138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:31.921448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:31.922232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:31.922544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:31.924169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:31.933400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 96/192] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:31.939567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:31.951330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ac015-7092-4525-8402-1519f9b979ac admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:31.955967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:31.957450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:31.957744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:31.958022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] PATH_INFO: `/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:31.959392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] RBAC: Authorizing `identity:get_user(user_id=a27299ef7f5a4c83bafcf85db2ea4e0f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:31.961672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:31.963387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 97/193] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:31 2021] GET /identity/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:31.969638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:31.979939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973fe54-60cf-4d99-b8e0-7d26ddf155c1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:31.984717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d950f-dbf8-4fa3-b51f-0a838e2a839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:31.985623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d950f-dbf8-4fa3-b51f-0a838e2a839c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:31.985913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d950f-dbf8-4fa3-b51f-0a838e2a839c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:31.986195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d950f-dbf8-4fa3-b51f-0a838e2a839c admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:31.987486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d950f-dbf8-4fa3-b51f-0a838e2a839c admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:31.989766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d950f-dbf8-4fa3-b51f-0a838e2a839c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:31.991526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 97/194] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:31 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:31.998766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.009858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3544e20-cfa7-4016-98cb-c6e8fb8d6516 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.014639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ab738-9731-45af-8f7d-594760969d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.015534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab738-9731-45af-8f7d-594760969d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.015872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab738-9731-45af-8f7d-594760969d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.016197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ab738-9731-45af-8f7d-594760969d57 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57/users/a27299ef7f5a4c83bafcf85db2ea4e0f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.018261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ab738-9731-45af-8f7d-594760969d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33cbbd3852e4283836762f9edd90a57, user_id=a27299ef7f5a4c83bafcf85db2ea4e0f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.021495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ab738-9731-45af-8f7d-594760969d57 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.036663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 98/195] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:31 2021] PUT /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57/users/a27299ef7f5a4c83bafcf85db2ea4e0f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:32.412465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e50fa-5dbf-42ef-a843-f100771f7c9d None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.412837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e50fa-5dbf-42ef-a843-f100771f7c9d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.413341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e50fa-5dbf-42ef-a843-f100771f7c9d None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.416243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 98/196] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:32.422444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125543c4-eec9-40e6-b185-b8bd829a6096 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.422735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125543c4-eec9-40e6-b185-b8bd829a6096 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.423012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125543c4-eec9-40e6-b185-b8bd829a6096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.443235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-125543c4-eec9-40e6-b185-b8bd829a6096 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:32.444437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-125543c4-eec9-40e6-b185-b8bd829a6096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:32.512766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 99/197] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:32.536991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e50fa-5dbf-42ef-a843-f100771f7c9d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.552614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e50fa-5dbf-42ef-a843-f100771f7c9d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.557800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.558722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.559105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.559457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.575486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:32.583264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:32.584868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 99/198] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:32.592213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125543c4-eec9-40e6-b185-b8bd829a6096 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.602902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125543c4-eec9-40e6-b185-b8bd829a6096 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.608231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.608975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.609267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.609625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.610428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:32.610848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.613097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.623324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 100/199] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:32.630537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.642871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b89283-b132-49fc-a775-39f8120a2d08 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.647763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.648689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.648981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.649257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.650542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.652369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.654136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 100/200] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:32.661031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.674053 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e31454-2c93-4e8e-9c3e-f9a047e9e8ba admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.679367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c08705-31e0-4862-9e42-2d439f434864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.680245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08705-31e0-4862-9e42-2d439f434864 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.680535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08705-31e0-4862-9e42-2d439f434864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.680814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c08705-31e0-4862-9e42-2d439f434864 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.682075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c08705-31e0-4862-9e42-2d439f434864 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.684283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c08705-31e0-4862-9e42-2d439f434864 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.686262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 101/201] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:32.693831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.706401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248f67-b827-474b-bb2d-8ae71a98474e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.712512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e384afd-2048-4267-b0c9-756b4161ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.713885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e384afd-2048-4267-b0c9-756b4161ddbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.714278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e384afd-2048-4267-b0c9-756b4161ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.714783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e384afd-2048-4267-b0c9-756b4161ddbf admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57/users/d4d408e2598343a193d18277dfdc0252/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.717634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e384afd-2048-4267-b0c9-756b4161ddbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33cbbd3852e4283836762f9edd90a57, user_id=d4d408e2598343a193d18277dfdc0252, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.720720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e384afd-2048-4267-b0c9-756b4161ddbf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.734047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157097-4d1e-4fd3-8674-4405c52171fd None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.734327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157097-4d1e-4fd3-8674-4405c52171fd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.734607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da157097-4d1e-4fd3-8674-4405c52171fd None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.737613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 102/202] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:32.740393 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76703-b9c0-4644-90b5-2db3582bc0ac None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.740893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76703-b9c0-4644-90b5-2db3582bc0ac None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.741401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76703-b9c0-4644-90b5-2db3582bc0ac None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.744074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 101/203] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:32 2021] PUT /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57/users/d4d408e2598343a193d18277dfdc0252/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:32.744605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 103/204] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:32.745523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df5e6-fe48-4e08-b387-b912d508441c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.745822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df5e6-fe48-4e08-b387-b912d508441c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.746240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df5e6-fe48-4e08-b387-b912d508441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.751574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77ace-e482-4e79-a801-4a6c3953db91 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.751979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77ace-e482-4e79-a801-4a6c3953db91 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.752287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77ace-e482-4e79-a801-4a6c3953db91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.770920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9a1df5e6-fe48-4e08-b387-b912d508441c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:32.772243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-25b77ace-e482-4e79-a801-4a6c3953db91 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:32.773013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9a1df5e6-fe48-4e08-b387-b912d508441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:32.773464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-25b77ace-e482-4e79-a801-4a6c3953db91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:32.862615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 104/205] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:32.887369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 102/206] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:32.891579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b77ace-e482-4e79-a801-4a6c3953db91 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.902141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b77ace-e482-4e79-a801-4a6c3953db91 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.907480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.908341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.908663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.908992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.911997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1df5e6-fe48-4e08-b387-b912d508441c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.921851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1df5e6-fe48-4e08-b387-b912d508441c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.928904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:32.930032 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.930946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.931228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.931501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.932932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.934814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.936650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 103/207] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:32.938281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:32.939805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 105/208] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:32.944110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.947933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.959931 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b82525-b2dd-4cb6-b7d3-d361db7986a4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.960243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc12107-ea5e-4859-ad44-a3b848a87940 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:32.964943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.965242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:32.965672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.965861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:32.966018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.966341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:32.966491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.966629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] PATH_INFO: `/v3/groups` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:32.967005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:32.967176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.967314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:32.968990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.969230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:32.985475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 106/209] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:32.992645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:32.996463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 104/210] 10.222.0.48 () {60 vars in 1155 bytes} [Tue Oct 12 16:35:32 2021] POST /identity/v3/groups => generated 226 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:33.015144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2f84a-f8df-4f2e-867f-272c2f513a10 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:33.021349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:33.022236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:33.023347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:33.023347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] PATH_INFO: `/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:33.024578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] RBAC: Authorizing `identity:get_user(user_id=a27299ef7f5a4c83bafcf85db2ea4e0f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:33.026847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:33.028728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 107/211] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:32 2021] GET /identity/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:33.035982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:33.046726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709e2ab-e6b4-4529-aab4-502cd7481fd5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:33.052134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9f1c-28da-4440-ad97-77bd2a2620c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:33.053208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9f1c-28da-4440-ad97-77bd2a2620c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:33.053428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9f1c-28da-4440-ad97-77bd2a2620c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:33.053720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9f1c-28da-4440-ad97-77bd2a2620c0 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:33.055064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9f1c-28da-4440-ad97-77bd2a2620c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:33.057143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9f1c-28da-4440-ad97-77bd2a2620c0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:33.059301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 105/212] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:33 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:33.065666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:33.078203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b612d-2cf8-4c9b-bb61-9cff209c6bba admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:33.083660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d98b4-9bc0-4be7-908c-2d17e151b933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:33.084772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d98b4-9bc0-4be7-908c-2d17e151b933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:33.085068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d98b4-9bc0-4be7-908c-2d17e151b933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:33.085410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d98b4-9bc0-4be7-908c-2d17e151b933 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57/users/a27299ef7f5a4c83bafcf85db2ea4e0f/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:33.088936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d98b4-9bc0-4be7-908c-2d17e151b933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33cbbd3852e4283836762f9edd90a57, user_id=a27299ef7f5a4c83bafcf85db2ea4e0f, role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:33.092150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d98b4-9bc0-4be7-908c-2d17e151b933 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:33.109027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 108/213] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:33 2021] PUT /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57/users/a27299ef7f5a4c83bafcf85db2ea4e0f/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:34.970789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c859a-b34c-4547-8380-efc85c1e7534 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:34.971311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c859a-b34c-4547-8380-efc85c1e7534 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:34.971383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c859a-b34c-4547-8380-efc85c1e7534 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:34.974605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 106/214] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:34.982375 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd25bd2-9d90-496a-95bc-b00264cd8024 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:34.982890 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd25bd2-9d90-496a-95bc-b00264cd8024 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:34.982966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd25bd2-9d90-496a-95bc-b00264cd8024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:35.006519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5cd25bd2-9d90-496a-95bc-b00264cd8024 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:35.007761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5cd25bd2-9d90-496a-95bc-b00264cd8024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:35.080914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 109/215] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:35.118511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c859a-b34c-4547-8380-efc85c1e7534 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:35.139174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c859a-b34c-4547-8380-efc85c1e7534 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:35.148496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:35.149348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:35.149660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:35.149943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:35.172706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:35.191480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:35.193882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 107/216] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:35.200676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd25bd2-9d90-496a-95bc-b00264cd8024 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:35.215040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd25bd2-9d90-496a-95bc-b00264cd8024 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:35.231116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:35.231729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:35.232013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:35.232286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:35.233066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:35.233391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:35.234996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:35.249576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 110/217] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:35.256663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:35.267793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4a6c9-fe7d-4c08-a337-71968dc1ad77 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:35.283360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:35.285446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:35.285938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:35.286407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] PATH_INFO: `/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:35.294828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] RBAC: Authorizing `identity:get_user(user_id=a27299ef7f5a4c83bafcf85db2ea4e0f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:35.298744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:35.301334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 108/218] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:35 2021] GET /identity/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:35.307882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:35.322826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38d4c9-e37c-4d84-a0d0-f823d773c67b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:35.335283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:35.335952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:35.336236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:35.336514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:35.353176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:35.354966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:35.367505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 111/219] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:35.373923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:35.390013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccb248-5eae-4201-8bcd-7ace897ab72d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:35.401781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bc7cc-d2b3-4892-9c7d-60d3587382aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:35.402935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bc7cc-d2b3-4892-9c7d-60d3587382aa admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:35.403412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bc7cc-d2b3-4892-9c7d-60d3587382aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:35.403766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bc7cc-d2b3-4892-9c7d-60d3587382aa admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:35.407022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bc7cc-d2b3-4892-9c7d-60d3587382aa admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:35.411758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bc7cc-d2b3-4892-9c7d-60d3587382aa admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:35.415100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 109/220] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:35 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:35.421738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:35.434845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe52ea-660b-4534-9582-c35bbb800cd4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:35.442009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f399de7-4baf-41ab-a52a-ae335c0348c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:35.442684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399de7-4baf-41ab-a52a-ae335c0348c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:35.442968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399de7-4baf-41ab-a52a-ae335c0348c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:35.443246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f399de7-4baf-41ab-a52a-ae335c0348c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:35.444301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399de7-4baf-41ab-a52a-ae335c0348c7 admin admin] RBAC: Adding query filter params (role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=d33cbbd3852e4283836762f9edd90a57, user.id=a27299ef7f5a4c83bafcf85db2ea4e0f) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:35.444617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399de7-4baf-41ab-a52a-ae335c0348c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:35.450768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f399de7-4baf-41ab-a52a-ae335c0348c7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:35.458312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 112/221] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:35 2021] GET /identity/v3/role_assignments?user.id=a27299ef7f5a4c83bafcf85db2ea4e0f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:36.056171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9c3f3-4050-4f45-8016-07b4d1d8c80c None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.056909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9c3f3-4050-4f45-8016-07b4d1d8c80c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.057132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9c3f3-4050-4f45-8016-07b4d1d8c80c None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.060606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 110/222] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:36.071602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bfff1-111a-438e-bc6a-688fb0cd81a8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.072271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bfff1-111a-438e-bc6a-688fb0cd81a8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.072800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bfff1-111a-438e-bc6a-688fb0cd81a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.103939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-231bfff1-111a-438e-bc6a-688fb0cd81a8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:36.105679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-231bfff1-111a-438e-bc6a-688fb0cd81a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:36.119533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 113/223] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:36.165501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9c3f3-4050-4f45-8016-07b4d1d8c80c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:36.183195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9c3f3-4050-4f45-8016-07b4d1d8c80c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:36.187982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:36.188794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.189086 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.189364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.204046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:36.211395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:36.212651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 111/224] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:36.219757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bfff1-111a-438e-bc6a-688fb0cd81a8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:36.229620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bfff1-111a-438e-bc6a-688fb0cd81a8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:36.234558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:36.235244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.235532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.235861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.236652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:36.236963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:36.239164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:36.254915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 114/225] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:36.261553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:36.281781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a027-4626-469e-9659-eb97b99aa774 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:36.288860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:36.290219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.290805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.291407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.295652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:36.298311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:36.301550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 112/226] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:36 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:36.308177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:36.325050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82126d9-1450-4db2-9b7b-5c55d4e7afec admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:36.334836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:36.335877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.336219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.336702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.350332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:36.353224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:36.370243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 115/227] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:36.377078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:36.395960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029191a2-dd7c-4ce4-a7d1-90878f777014 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:36.402622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8485da6-dddb-4487-8531-ef087d129311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:36.404120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485da6-dddb-4487-8531-ef087d129311 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.404633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485da6-dddb-4487-8531-ef087d129311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.405128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8485da6-dddb-4487-8531-ef087d129311 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.407349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8485da6-dddb-4487-8531-ef087d129311 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:36.410672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8485da6-dddb-4487-8531-ef087d129311 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:36.413197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 113/228] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:36 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:36.420620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:36.440908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412d272-6e12-4bdb-9688-4353c69f0a98 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:36.449323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbb519-0121-40a0-8ce6-f070ad97dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:36.450423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbb519-0121-40a0-8ce6-f070ad97dec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.450847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbb519-0121-40a0-8ce6-f070ad97dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.451237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbb519-0121-40a0-8ce6-f070ad97dec5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.452471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbb519-0121-40a0-8ce6-f070ad97dec5 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=d33cbbd3852e4283836762f9edd90a57, user.id=d4d408e2598343a193d18277dfdc0252) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:36.452956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbb519-0121-40a0-8ce6-f070ad97dec5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:36.455919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbb519-0121-40a0-8ce6-f070ad97dec5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:36.467376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 116/229] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:36 2021] GET /identity/v3/role_assignments?user.id=d4d408e2598343a193d18277dfdc0252&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:36.794508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d654-9365-49c9-8867-5e7919979d19 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.794896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d654-9365-49c9-8867-5e7919979d19 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.795059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059d654-9365-49c9-8867-5e7919979d19 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.797244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 114/230] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:36.820138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d6b3c-e3c5-42c7-b783-5472d0850a5e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.820138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d6b3c-e3c5-42c7-b783-5472d0850a5e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.820138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d6b3c-e3c5-42c7-b783-5472d0850a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:36.850614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ad8d6b3c-e3c5-42c7-b783-5472d0850a5e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:36.852162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ad8d6b3c-e3c5-42c7-b783-5472d0850a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:36.861142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 117/231] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:36.948396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059d654-9365-49c9-8867-5e7919979d19 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:36.967924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059d654-9365-49c9-8867-5e7919979d19 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:36.975737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98b771-44f2-40b2-8a29-46baebdbebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:36.977183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b771-44f2-40b2-8a29-46baebdbebe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:36.977651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b771-44f2-40b2-8a29-46baebdbebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:36.978074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98b771-44f2-40b2-8a29-46baebdbebe9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.000936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98b771-44f2-40b2-8a29-46baebdbebe9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:37.015881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-8d98b771-44f2-40b2-8a29-46baebdbebe9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:37.018265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 115/232] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:37.027539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d6b3c-e3c5-42c7-b783-5472d0850a5e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.043758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d6b3c-e3c5-42c7-b783-5472d0850a5e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.060702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac667ed-b3ce-45dc-93a9-6b37bc587eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.062115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac667ed-b3ce-45dc-93a9-6b37bc587eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.062787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac667ed-b3ce-45dc-93a9-6b37bc587eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.063483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac667ed-b3ce-45dc-93a9-6b37bc587eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.064504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac667ed-b3ce-45dc-93a9-6b37bc587eb3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:37.065007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac667ed-b3ce-45dc-93a9-6b37bc587eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.067454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac667ed-b3ce-45dc-93a9-6b37bc587eb3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.093860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 118/233] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:37.096048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3e28-4fb9-4f48-8d7a-581e36b95548 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.096675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3e28-4fb9-4f48-8d7a-581e36b95548 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.096802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3e28-4fb9-4f48-8d7a-581e36b95548 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.099068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 116/234] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:37.106186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482c50-d872-4ef0-8772-a583ae2addeb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.106827 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482c50-d872-4ef0-8772-a583ae2addeb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.107308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482c50-d872-4ef0-8772-a583ae2addeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.111304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3e28-4fb9-4f48-8d7a-581e36b95548 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.134959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-80482c50-d872-4ef0-8772-a583ae2addeb None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:37.136523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-80482c50-d872-4ef0-8772-a583ae2addeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:37.140144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3e28-4fb9-4f48-8d7a-581e36b95548 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.151038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 119/235] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:37.152149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.153092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.153405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.153683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] PATH_INFO: `/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.155033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] RBAC: Authorizing `identity:get_user(user_id=a27299ef7f5a4c83bafcf85db2ea4e0f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.157403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.159220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 117/236] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:37.168013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482c50-d872-4ef0-8772-a583ae2addeb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.182876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482c50-d872-4ef0-8772-a583ae2addeb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.190632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.191954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.192279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.192639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.203036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.204979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.215807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 120/237] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:37.225295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.237132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.243170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767451f8-ed71-4ec3-93cf-45a1ef32e408 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.252609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.253547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.253881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.254165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.257247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511cb32-a24b-422d-85bd-38ff02bb4712 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.258182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.260276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.262295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 118/238] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:37.265144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.266061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.266353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.266633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.273047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.291174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:37.304512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07082938-f8c6-4ad3-be5e-9a808f6d569e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.312144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:37.315448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.316134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.316491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.316771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.317774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] RBAC: Adding query filter params (role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=d33cbbd3852e4283836762f9edd90a57, user.id=a27299ef7f5a4c83bafcf85db2ea4e0f) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:37.318091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.320291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 121/239] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:37.320489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.327373 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.338353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 119/240] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/role_assignments?user.id=a27299ef7f5a4c83bafcf85db2ea4e0f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 608 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:37.345203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadfc9f5-92ee-4b8f-ba59-0dfbec096ccb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.351105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.352006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.352401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.352686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.353921 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:37.354281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.356720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.368715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 122/241] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:37.376432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.389059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae786c8-85b8-462a-b210-169f3acee2bd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.396857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.397618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.397997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.398421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.409036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.412382 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.428428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 120/242] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:37.437323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.451026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70cf73-ea08-451a-95aa-4eee8e73433f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.458563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.460225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.460728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.461282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.463669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.467918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.471466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 123/243] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:37.481304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.496939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc0999-e9e6-4bdd-9962-c08bede1f930 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.504586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b733976-7132-4e01-8380-15a44a7da481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.505793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733976-7132-4e01-8380-15a44a7da481 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.506303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733976-7132-4e01-8380-15a44a7da481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.506813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733976-7132-4e01-8380-15a44a7da481 admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.515438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b733976-7132-4e01-8380-15a44a7da481 admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.516498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-6b733976-7132-4e01-8380-15a44a7da481 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:37.516498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:37.516498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:37.517752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b733976-7132-4e01-8380-15a44a7da481 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.519686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 121/244] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:37.531119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:37.548499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cbdaf-0186-4630-b3a7-75f9befe062a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:37.559371 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697519f-113e-4cda-b986-79da19f61590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:37.560476 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697519f-113e-4cda-b986-79da19f61590 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:37.560770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697519f-113e-4cda-b986-79da19f61590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:37.561297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697519f-113e-4cda-b986-79da19f61590 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:37.562713 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697519f-113e-4cda-b986-79da19f61590 admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=3b38fac5719442ec8d74d1de558e09b0) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:37.563206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697519f-113e-4cda-b986-79da19f61590 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:37.567266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697519f-113e-4cda-b986-79da19f61590 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:37.580842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 124/245] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:37 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:38.293812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539deecb-8f36-4155-b8b0-2094a96290e5 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.294425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539deecb-8f36-4155-b8b0-2094a96290e5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.294425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539deecb-8f36-4155-b8b0-2094a96290e5 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.296317 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 122/246] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:38.307577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5016f74-6833-47f6-8588-247b34207581 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.308385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5016f74-6833-47f6-8588-247b34207581 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.308385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5016f74-6833-47f6-8588-247b34207581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.476738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b5016f74-6833-47f6-8588-247b34207581 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:38.478732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b5016f74-6833-47f6-8588-247b34207581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:38.489271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 125/247] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:38.523082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539deecb-8f36-4155-b8b0-2094a96290e5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:38.545506 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539deecb-8f36-4155-b8b0-2094a96290e5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:38.547507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:38.548603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.549120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.549663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.569407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:38.576616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:38.578192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 123/248] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:38.587002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5016f74-6833-47f6-8588-247b34207581 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:38.598701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5016f74-6833-47f6-8588-247b34207581 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:38.604226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:38.605041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.605447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.605822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.606740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:38.607117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:38.609205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:38.620107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 126/249] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:38.626737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:38.637595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181a2c6-0c01-467b-adfe-1df6b60cd999 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:38.643298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:38.644151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.644996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.645346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.654047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:38.655820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:38.665901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 124/250] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:38.672409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:38.684712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060afbff-b4f3-4722-82f9-f4173bf10cab admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:38.690633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:38.692154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.692444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.692723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.694007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:38.696092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:38.698099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 127/251] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:38 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:38.705085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:38.715304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de746972-d14c-4879-bb66-150c3f35efd8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:38.723324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5f593-8306-4685-81f3-292eba1a22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:38.724572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5f593-8306-4685-81f3-292eba1a22ca admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.724862 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5f593-8306-4685-81f3-292eba1a22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.725143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5f593-8306-4685-81f3-292eba1a22ca admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.727477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5f593-8306-4685-81f3-292eba1a22ca admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:38.730429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5f593-8306-4685-81f3-292eba1a22ca admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:38.733099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 125/252] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:38 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:38.741750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:38.752774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3fc5-cffd-42ee-8233-6b4394d1e7c7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:38.758434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d07652-875a-4e8c-9bdb-fc523aeb1fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:38.759183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07652-875a-4e8c-9bdb-fc523aeb1fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.759475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07652-875a-4e8c-9bdb-fc523aeb1fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.759758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d07652-875a-4e8c-9bdb-fc523aeb1fcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.760659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d07652-875a-4e8c-9bdb-fc523aeb1fcf admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=3b38fac5719442ec8d74d1de558e09b0) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:38.760979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d07652-875a-4e8c-9bdb-fc523aeb1fcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:38.762967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d07652-875a-4e8c-9bdb-fc523aeb1fcf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:38.769486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 128/253] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:38 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:38.901407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4a0e-5644-4e23-a144-1c03938c4b53 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.901851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4a0e-5644-4e23-a144-1c03938c4b53 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.901851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e4a0e-5644-4e23-a144-1c03938c4b53 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.903977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 126/254] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:38.917297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d3f6e-054e-411f-bc88-89f7e4dd987b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:38.917723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d3f6e-054e-411f-bc88-89f7e4dd987b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:38.917962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d3f6e-054e-411f-bc88-89f7e4dd987b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:38.950647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fb5d3f6e-054e-411f-bc88-89f7e4dd987b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:38.951911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fb5d3f6e-054e-411f-bc88-89f7e4dd987b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:38.961167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 129/255] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:39.002977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4a0e-5644-4e23-a144-1c03938c4b53 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.015509 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e4a0e-5644-4e23-a144-1c03938c4b53 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.020918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.021767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.022054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.022319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.034332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:39.043558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:39.045219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 127/256] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:38 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:39.052329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d3f6e-054e-411f-bc88-89f7e4dd987b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.061980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d3f6e-054e-411f-bc88-89f7e4dd987b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.069514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.070217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.070509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.070766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.071572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:39.071880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.074350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.091576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 130/257] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:39.097932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.111595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffeff1-3cda-47a7-897f-1784977a8bdb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.117466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.118304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.118658 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.119019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.131743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.135076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.151644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 128/258] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:39.157568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.168785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc27b3-f865-4452-998b-606f817305f7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.174922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.176669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.177006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.177553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.179326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.182224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.184954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 131/259] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:39.192043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.204775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88780-7d46-4f00-8428-03cd518e1874 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.216733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4860e5-f5e0-4acf-9732-a026a34c8e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.217765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4860e5-f5e0-4acf-9732-a026a34c8e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.218084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4860e5-f5e0-4acf-9732-a026a34c8e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.218434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4860e5-f5e0-4acf-9732-a026a34c8e3e admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.222495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4860e5-f5e0-4acf-9732-a026a34c8e3e admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.224910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4860e5-f5e0-4acf-9732-a026a34c8e3e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.227367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 129/260] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:39.236739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.262266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612aa54-b86e-41ca-81a9-55ebaf07ace4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.280097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648f890-be38-45ff-8b99-8485ee037afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.280841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648f890-be38-45ff-8b99-8485ee037afc admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.281129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648f890-be38-45ff-8b99-8485ee037afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.281452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648f890-be38-45ff-8b99-8485ee037afc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.282387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648f890-be38-45ff-8b99-8485ee037afc admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=d33cbbd3852e4283836762f9edd90a57) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:39.282686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648f890-be38-45ff-8b99-8485ee037afc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.284672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648f890-be38-45ff-8b99-8485ee037afc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.292732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 132/261] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:39.431145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ee420-6ead-4950-b256-dffc1e97c5d1 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.431929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ee420-6ead-4950-b256-dffc1e97c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.431929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ee420-6ead-4950-b256-dffc1e97c5d1 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.433532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 130/262] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:39.440167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e4f-a18b-4890-8a50-6e758cf7bdcd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.440870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e4f-a18b-4890-8a50-6e758cf7bdcd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.440870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e4f-a18b-4890-8a50-6e758cf7bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.473251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d74e9e4f-a18b-4890-8a50-6e758cf7bdcd None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:39.474577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d74e9e4f-a18b-4890-8a50-6e758cf7bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:39.482855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:39.509717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ee420-6ead-4950-b256-dffc1e97c5d1 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.527434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ee420-6ead-4950-b256-dffc1e97c5d1 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.533907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.535047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.536093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.536406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.557480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:39.567121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:39.569060 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 131/264] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:39.576299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9e4f-a18b-4890-8a50-6e758cf7bdcd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.590799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9e4f-a18b-4890-8a50-6e758cf7bdcd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.595640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.596387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.596674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.597005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.603570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:39.603880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.605645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.616498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:39.623201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.642411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84427f5-78e7-4a80-b4bd-b3ab7a449139 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.653148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.653874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.654158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.654590 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.671287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.673159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.689409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 132/266] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:39.696061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.710947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a658b90-a66e-4eca-b91e-0749fc8e3c3f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.721243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.722415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.723372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.723853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.730214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.732613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.734446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 135/267] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:39.745818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.757574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df7568-c1a6-4721-ab17-e069bd7b371c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.767215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71dba4-43a2-40bd-b06e-9790e9d2fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.768444 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71dba4-43a2-40bd-b06e-9790e9d2fb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.768718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71dba4-43a2-40bd-b06e-9790e9d2fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.769041 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71dba4-43a2-40bd-b06e-9790e9d2fb3f admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.772057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71dba4-43a2-40bd-b06e-9790e9d2fb3f admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.774091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71dba4-43a2-40bd-b06e-9790e9d2fb3f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.776198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 133/268] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:39.783776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:39.800170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd1aa0-787f-4c37-a746-7e1ab487bbe2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:39.805664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157be706-41d9-4fc2-8197-2308a8af2c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:39.806345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be706-41d9-4fc2-8197-2308a8af2c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:39.806637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be706-41d9-4fc2-8197-2308a8af2c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:39.806910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157be706-41d9-4fc2-8197-2308a8af2c65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:39.807800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be706-41d9-4fc2-8197-2308a8af2c65 admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=d33cbbd3852e4283836762f9edd90a57) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:39.808117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be706-41d9-4fc2-8197-2308a8af2c65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:39.810786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157be706-41d9-4fc2-8197-2308a8af2c65 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:39.824214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 136/269] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:39 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:40.060749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0675-5416-43e0-90d6-16a2c89b04da None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.061102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0675-5416-43e0-90d6-16a2c89b04da None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.061441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0675-5416-43e0-90d6-16a2c89b04da None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.064299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 134/270] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:40.071214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b4c02-7c60-4b25-a12d-65127b3a3468 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.071849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b4c02-7c60-4b25-a12d-65127b3a3468 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.072352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b4c02-7c60-4b25-a12d-65127b3a3468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.095575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-068b4c02-7c60-4b25-a12d-65127b3a3468 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:40.097245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-068b4c02-7c60-4b25-a12d-65127b3a3468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:40.106261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 137/271] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:40.132965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d0675-5416-43e0-90d6-16a2c89b04da None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:40.147782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d0675-5416-43e0-90d6-16a2c89b04da None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:40.152652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:40.153821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.154312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.154787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.174473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:40.182306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:40.184244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 135/272] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:40.191138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b4c02-7c60-4b25-a12d-65127b3a3468 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:40.203893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b4c02-7c60-4b25-a12d-65127b3a3468 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:40.213749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:40.214952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.215441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.215927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.216915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:40.217450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:40.219320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:40.233682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 138/273] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:40.240634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:40.251759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570510-1208-4b46-a43f-adad98dccf3a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:40.261475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:40.262780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.263268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.263782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.275016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:40.277202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:40.290953 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 136/274] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:40.297950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:40.308778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1060dd0-6ff6-48d9-b604-fd55b980d83e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:40.314274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:40.315538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.316093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.317221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] PATH_INFO: `/v3/projects/64da0972f6f84075a0e8956810e3e6c1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.318954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=64da0972f6f84075a0e8956810e3e6c1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:40.321093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:40.323552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 139/275] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:40 2021] GET /identity/v3/projects/64da0972f6f84075a0e8956810e3e6c1 => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:40.330103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:40.341156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41d9b-b797-4d6e-888b-8a7084d69060 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:40.346400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fa1b5-71bc-4a03-9221-14faf01f967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:40.347713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fa1b5-71bc-4a03-9221-14faf01f967d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.348245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fa1b5-71bc-4a03-9221-14faf01f967d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.348749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fa1b5-71bc-4a03-9221-14faf01f967d admin admin] PATH_INFO: `/v3/groups/bdbb57f5657746018343902edad1acb2` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.363126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fa1b5-71bc-4a03-9221-14faf01f967d admin admin] RBAC: Authorizing `identity:get_group(group_id=bdbb57f5657746018343902edad1acb2)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:40.365503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fa1b5-71bc-4a03-9221-14faf01f967d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:40.367687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 137/276] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:40 2021] GET /identity/v3/groups/bdbb57f5657746018343902edad1acb2 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:40.376631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:40.395371 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ec277-8c9a-4bff-83a0-18977970afd9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:40.403288 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030504e6-ae26-4798-9c1e-d8e4f9931646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:40.404685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030504e6-ae26-4798-9c1e-d8e4f9931646 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:40.405572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030504e6-ae26-4798-9c1e-d8e4f9931646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:40.406572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030504e6-ae26-4798-9c1e-d8e4f9931646 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:40.408105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030504e6-ae26-4798-9c1e-d8e4f9931646 admin admin] RBAC: Adding query filter params (group.id=bdbb57f5657746018343902edad1acb2, role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=64da0972f6f84075a0e8956810e3e6c1) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:40.408847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030504e6-ae26-4798-9c1e-d8e4f9931646 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:40.411858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030504e6-ae26-4798-9c1e-d8e4f9931646 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:40.420286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 140/277] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:40 2021] GET /identity/v3/role_assignments?group.id=bdbb57f5657746018343902edad1acb2&scope.project.id=64da0972f6f84075a0e8956810e3e6c1&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:41.780519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89005f3-557c-4157-b7bd-dffe9a594c77 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:41.781042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89005f3-557c-4157-b7bd-dffe9a594c77 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:41.781117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89005f3-557c-4157-b7bd-dffe9a594c77 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:41.783282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 138/278] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:41.793260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39140b0f-5689-4655-8df8-3586f0559595 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:41.794308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39140b0f-5689-4655-8df8-3586f0559595 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:41.794790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39140b0f-5689-4655-8df8-3586f0559595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:41.821996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-39140b0f-5689-4655-8df8-3586f0559595 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:41.823908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-39140b0f-5689-4655-8df8-3586f0559595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:41.834002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 141/279] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:41.882878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89005f3-557c-4157-b7bd-dffe9a594c77 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:41.899093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89005f3-557c-4157-b7bd-dffe9a594c77 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:41.906076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:41.906895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:41.907179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:41.907456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:41.923234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:41.932648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:41.938076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 139/280] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:41.945291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39140b0f-5689-4655-8df8-3586f0559595 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:41.963297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39140b0f-5689-4655-8df8-3586f0559595 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:41.975380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:41.976749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:41.977432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:41.977995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:41.979267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:41.979818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:41.982239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.003743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 142/281] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:41 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:42.010756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.033304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1afd-cf78-4757-8b4b-91f4661b994b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.040142 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.041869 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.042430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.042934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.050362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:42.053326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.055817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 140/282] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:42 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:42.064323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.079374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01e169-5c87-4fc7-aaab-90db57767390 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.085986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72e3c3-06fb-4c7a-8cc6-f26e5247406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.087648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e3c3-06fb-4c7a-8cc6-f26e5247406a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.088176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e3c3-06fb-4c7a-8cc6-f26e5247406a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.088681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72e3c3-06fb-4c7a-8cc6-f26e5247406a admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.094579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e3c3-06fb-4c7a-8cc6-f26e5247406a admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:42.097748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72e3c3-06fb-4c7a-8cc6-f26e5247406a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.101858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 143/283] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:42 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:42.112559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.131360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12941a-825c-4f45-800a-99c856371e38 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.141660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc991626-7452-4714-9130-3ea7a117ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.142557 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991626-7452-4714-9130-3ea7a117ac8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.142836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991626-7452-4714-9130-3ea7a117ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.143107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991626-7452-4714-9130-3ea7a117ac8f admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0/groups/925f602b99544e6abf80ef523b8dda2f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.151005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc991626-7452-4714-9130-3ea7a117ac8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b38fac5719442ec8d74d1de558e09b0, group_id=925f602b99544e6abf80ef523b8dda2f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:42.153694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc991626-7452-4714-9130-3ea7a117ac8f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.176107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 141/284] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 12 16:35:42 2021] PUT /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0/groups/925f602b99544e6abf80ef523b8dda2f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:42.237870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939eec5-90fd-4242-be05-e636d771ae02 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.238544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939eec5-90fd-4242-be05-e636d771ae02 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.239059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939eec5-90fd-4242-be05-e636d771ae02 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.241080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 144/285] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:35:42.248231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300636e-4f13-42a8-819e-b4d21866c638 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.248546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300636e-4f13-42a8-819e-b4d21866c638 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.248799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300636e-4f13-42a8-819e-b4d21866c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.272722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b300636e-4f13-42a8-819e-b4d21866c638 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:42.274121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b300636e-4f13-42a8-819e-b4d21866c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:42.352511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 142/286] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:42.402404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939eec5-90fd-4242-be05-e636d771ae02 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.436238 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939eec5-90fd-4242-be05-e636d771ae02 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.451521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.453450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.454271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.455019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.487032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:42.501355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:42.505040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 145/287] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:42.511709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300636e-4f13-42a8-819e-b4d21866c638 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.525686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300636e-4f13-42a8-819e-b4d21866c638 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.543391 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.544085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.544366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.544641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.545453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:42.545764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:42.547413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.561620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 143/288] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:42.567598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.579808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7fdb6-2e72-4e7f-950b-0c6d59da0945 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.587711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.588585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.588868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.589143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.591140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:42.592186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:42.592186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:42.592186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:42.593406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.595541 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 146/289] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:42 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:42.602628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.613086 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317425-5ea1-4608-bff7-8c3963455077 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.638879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba13c69-ac79-4eb2-932b-27e78203763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.639865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13c69-ac79-4eb2-932b-27e78203763c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.640141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13c69-ac79-4eb2-932b-27e78203763c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.640422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba13c69-ac79-4eb2-932b-27e78203763c admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.641722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba13c69-ac79-4eb2-932b-27e78203763c admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:42.643830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba13c69-ac79-4eb2-932b-27e78203763c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.646485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 144/290] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:42 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:42.652657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:42.677427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af035241-6844-4cae-911b-e61ca2e88b91 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:42.694854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2b2ab-6784-4656-87b8-ed0ea407533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:42.695762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2b2ab-6784-4656-87b8-ed0ea407533c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.696056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2b2ab-6784-4656-87b8-ed0ea407533c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.696334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2b2ab-6784-4656-87b8-ed0ea407533c admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57/groups/925f602b99544e6abf80ef523b8dda2f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.702862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2b2ab-6784-4656-87b8-ed0ea407533c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33cbbd3852e4283836762f9edd90a57, group_id=925f602b99544e6abf80ef523b8dda2f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:42.705551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2b2ab-6784-4656-87b8-ed0ea407533c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:42.749404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 147/291] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 12 16:35:42 2021] PUT /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57/groups/925f602b99544e6abf80ef523b8dda2f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:35:42.852233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15437b-75d0-4ac9-8dbf-14a171c1f222 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.853042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15437b-75d0-4ac9-8dbf-14a171c1f222 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.853042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15437b-75d0-4ac9-8dbf-14a171c1f222 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.855059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 145/292] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:42.877536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75220e-475d-46b7-b44b-aba1bd2c24fd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:42.878298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75220e-475d-46b7-b44b-aba1bd2c24fd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:42.878298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75220e-475d-46b7-b44b-aba1bd2c24fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:42.914636 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0c75220e-475d-46b7-b44b-aba1bd2c24fd None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:42.915872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c75220e-475d-46b7-b44b-aba1bd2c24fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:43.052731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 148/293] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:43.100312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15437b-75d0-4ac9-8dbf-14a171c1f222 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:43.128507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15437b-75d0-4ac9-8dbf-14a171c1f222 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:43.138322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:43.139150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:43.139432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:43.139708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:43.156934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:43.167003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:43.170845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 146/294] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:43.177983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75220e-475d-46b7-b44b-aba1bd2c24fd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:43.205819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75220e-475d-46b7-b44b-aba1bd2c24fd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:43.223756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:43.224841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:43.225331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:43.225849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:43.227227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:43.227733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:43.230533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:43.257047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 149/295] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:43.266505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:43.285096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fbabf-00e4-40ef-859a-b42ca1f645d7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:43.310131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:43.311011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:43.311293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:43.311570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:43.318199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:43.320104 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:43.321808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 147/296] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:43 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:43.331158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:43.363723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6ad3b-c6f2-4678-b4e0-c8bc2a61cb56 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:43.386339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fb3ce-d63a-4aaa-ab88-82a318930fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:43.387625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb3ce-d63a-4aaa-ab88-82a318930fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:43.388128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb3ce-d63a-4aaa-ab88-82a318930fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:43.388620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fb3ce-d63a-4aaa-ab88-82a318930fb6 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:43.392079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb3ce-d63a-4aaa-ab88-82a318930fb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:43.395958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fb3ce-d63a-4aaa-ab88-82a318930fb6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:43.399384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 150/297] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:43 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:43.410456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:43.428659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807ee18-9b19-4a4a-8ee5-94f8743befc0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:43.443480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fd0d9-73c6-4ecb-937d-c0e817b41daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:43.444379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fd0d9-73c6-4ecb-937d-c0e817b41daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:43.444654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fd0d9-73c6-4ecb-937d-c0e817b41daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:43.444936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fd0d9-73c6-4ecb-937d-c0e817b41daa admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0/groups/925f602b99544e6abf80ef523b8dda2f/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:43.452728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fd0d9-73c6-4ecb-937d-c0e817b41daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b38fac5719442ec8d74d1de558e09b0, group_id=925f602b99544e6abf80ef523b8dda2f, role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:43.455415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fd0d9-73c6-4ecb-937d-c0e817b41daa admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:43.480060 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 148/298] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 12 16:35:43 2021] PUT /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0/groups/925f602b99544e6abf80ef523b8dda2f/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:43.931186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef311-0b3e-4745-bddb-e78bef45772d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:43.931186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef311-0b3e-4745-bddb-e78bef45772d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:43.931186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cef311-0b3e-4745-bddb-e78bef45772d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:43.932467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 151/299] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:43 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:43.939942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403e37b-1a63-4e7b-b547-223592da196b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:43.940699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403e37b-1a63-4e7b-b547-223592da196b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:43.940699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403e37b-1a63-4e7b-b547-223592da196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:43.974541 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7403e37b-1a63-4e7b-b547-223592da196b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:43.975783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7403e37b-1a63-4e7b-b547-223592da196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:44.063076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 149/300] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:44.111518 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef311-0b3e-4745-bddb-e78bef45772d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.143951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cef311-0b3e-4745-bddb-e78bef45772d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.158277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.159662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.160160 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.160681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.195109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:44.217115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:44.219752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 152/301] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:44.229888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403e37b-1a63-4e7b-b547-223592da196b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.251824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403e37b-1a63-4e7b-b547-223592da196b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.266160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.266910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.267200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.267529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.268368 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:44.268722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:44.270565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:44.285127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 150/302] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:44.292418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.326109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1965-fe02-403c-9b3e-65f19dbeae52 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.340558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.341941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.342431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.342906 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.350915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:44.354472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:44.357782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 153/303] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:44.365627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.383914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef0408-a571-4824-9a75-f96dfec5ccb7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.394377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b379fe-16ba-4cae-9156-b53f7daf0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.395825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b379fe-16ba-4cae-9156-b53f7daf0cba admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.396113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b379fe-16ba-4cae-9156-b53f7daf0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.396374 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b379fe-16ba-4cae-9156-b53f7daf0cba admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.398007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b379fe-16ba-4cae-9156-b53f7daf0cba admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:44.400123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b379fe-16ba-4cae-9156-b53f7daf0cba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:44.402331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 151/304] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:44.409076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.443950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8cb99-1ec4-4b4d-9e48-a1c30196a95c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.454904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635fcae5-1e7d-44d2-94a9-39c464de2d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.456299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcae5-1e7d-44d2-94a9-39c464de2d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.456782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcae5-1e7d-44d2-94a9-39c464de2d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.457250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635fcae5-1e7d-44d2-94a9-39c464de2d60 admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57/groups/925f602b99544e6abf80ef523b8dda2f/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.463278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fcae5-1e7d-44d2-94a9-39c464de2d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33cbbd3852e4283836762f9edd90a57, group_id=925f602b99544e6abf80ef523b8dda2f, role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:44.465975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635fcae5-1e7d-44d2-94a9-39c464de2d60 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:44.492802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 154/305] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 12 16:35:44 2021] PUT /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57/groups/925f602b99544e6abf80ef523b8dda2f/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:44.543586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbf8e-2f9a-4b03-85fc-6f3908d9f381 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.543908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbf8e-2f9a-4b03-85fc-6f3908d9f381 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.544143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbf8e-2f9a-4b03-85fc-6f3908d9f381 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.546363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 152/306] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:44.564562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107c73-7be2-43ef-a8e6-1cd7b2829147 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.565068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107c73-7be2-43ef-a8e6-1cd7b2829147 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.565602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6107c73-7be2-43ef-a8e6-1cd7b2829147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.605417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f6107c73-7be2-43ef-a8e6-1cd7b2829147 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:44.607638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f6107c73-7be2-43ef-a8e6-1cd7b2829147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:44.696013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 155/307] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:44.759521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbf8e-2f9a-4b03-85fc-6f3908d9f381 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.786912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbf8e-2f9a-4b03-85fc-6f3908d9f381 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.794051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.795485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.795944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.796428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.816141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:44.829816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:44.832311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 153/308] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:44.839111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6107c73-7be2-43ef-a8e6-1cd7b2829147 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.850653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6107c73-7be2-43ef-a8e6-1cd7b2829147 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.856305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.857039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.857330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.857709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.858446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:44.858753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:44.860478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:44.876829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 156/309] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:44.884514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.903438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5359a-c496-4c6a-9256-c7d56880dd8c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.914903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.916286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.917116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.917735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] PATH_INFO: `/v3/groups/bdbb57f5657746018343902edad1acb2` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.922630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] RBAC: Authorizing `identity:get_group(group_id=bdbb57f5657746018343902edad1acb2)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:44.925427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:44.929045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 154/310] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/groups/bdbb57f5657746018343902edad1acb2 => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:44.935121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.946458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa707f68-440e-49f7-8496-d767ee638977 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.954584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbb28a-1d4f-4285-a46b-446f022e0913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.955521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb28a-1d4f-4285-a46b-446f022e0913 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.955811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb28a-1d4f-4285-a46b-446f022e0913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.956099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbb28a-1d4f-4285-a46b-446f022e0913 admin admin] PATH_INFO: `/v3/projects/64da0972f6f84075a0e8956810e3e6c1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.957542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbb28a-1d4f-4285-a46b-446f022e0913 admin admin] RBAC: Authorizing `identity:get_project(project_id=64da0972f6f84075a0e8956810e3e6c1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:44.959680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbb28a-1d4f-4285-a46b-446f022e0913 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:44.961497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 157/311] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:44 2021] GET /identity/v3/projects/64da0972f6f84075a0e8956810e3e6c1 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:44.968320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:44.979743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ed564-aee3-4e2b-9007-02f9f836c5a9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:44.990052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6b89b-ead4-41fb-a3c8-ee3db21d3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:44.991272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6b89b-ead4-41fb-a3c8-ee3db21d3e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:44.991820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6b89b-ead4-41fb-a3c8-ee3db21d3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:44.992207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6b89b-ead4-41fb-a3c8-ee3db21d3e2f admin admin] PATH_INFO: `/v3/projects/64da0972f6f84075a0e8956810e3e6c1/groups/bdbb57f5657746018343902edad1acb2/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:44.996214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6b89b-ead4-41fb-a3c8-ee3db21d3e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64da0972f6f84075a0e8956810e3e6c1, group_id=bdbb57f5657746018343902edad1acb2, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:45.000068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6b89b-ead4-41fb-a3c8-ee3db21d3e2f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:45.022065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 155/312] 10.222.0.48 () {58 vars in 1463 bytes} [Tue Oct 12 16:35:44 2021] PUT /identity/v3/projects/64da0972f6f84075a0e8956810e3e6c1/groups/bdbb57f5657746018343902edad1acb2/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:45.690921 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a86de-0006-4661-8f7f-87d41ef5cfc5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:45.691213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a86de-0006-4661-8f7f-87d41ef5cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:45.691745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a86de-0006-4661-8f7f-87d41ef5cfc5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:45.693815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 158/313] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:45.715768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48569-e20b-4f94-be80-b4a5910e4ae2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:45.716405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48569-e20b-4f94-be80-b4a5910e4ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:45.716889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf48569-e20b-4f94-be80-b4a5910e4ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:45.740812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8cf48569-e20b-4f94-be80-b4a5910e4ae2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:45.742467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8cf48569-e20b-4f94-be80-b4a5910e4ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:45.824818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 156/314] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:45.859830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a86de-0006-4661-8f7f-87d41ef5cfc5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:45.876553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a86de-0006-4661-8f7f-87d41ef5cfc5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:45.886724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:45.887984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:45.888507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:45.888991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:45.905918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:45.913985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:45.915512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 159/315] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:45 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:45.921924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf48569-e20b-4f94-be80-b4a5910e4ae2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:45.931834 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf48569-e20b-4f94-be80-b4a5910e4ae2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:45.939523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:45.940485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:45.941030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:45.941645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:45.942647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] RBAC: Adding query filter params (name=member) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:45.943190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:45.945055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:45.954914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 157/316] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:45.962874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:45.975598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f98e-ec19-4a6a-be65-1f04b4d284f3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:45.985566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:45.986519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:45.987065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:45.987569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.005615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.007383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.024421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 160/317] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:35:46.031591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.049461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3419eb6-1edc-4916-8f00-8c27310d2170 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.060330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.061574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.062102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.062617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.065796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.068222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.070244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 158/318] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:46.076716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.090720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d23fa-60ac-49fc-8e81-1ce94eaf36ad admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.102551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0b037-6af4-43d5-a64c-629e850a4ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.103428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b037-6af4-43d5-a64c-629e850a4ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.103716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b037-6af4-43d5-a64c-629e850a4ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.103997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b037-6af4-43d5-a64c-629e850a4ec1 admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.110427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0b037-6af4-43d5-a64c-629e850a4ec1 admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.112666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0b037-6af4-43d5-a64c-629e850a4ec1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.114570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 161/319] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:46.121825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.139412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca139fb-0600-496c-a9b4-1c2afe9ba61d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.149938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7295e-ae8e-4d6f-8d0d-0353b48a420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.151106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7295e-ae8e-4d6f-8d0d-0353b48a420c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.151904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7295e-ae8e-4d6f-8d0d-0353b48a420c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.152678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7295e-ae8e-4d6f-8d0d-0353b48a420c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.154218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7295e-ae8e-4d6f-8d0d-0353b48a420c admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=3b38fac5719442ec8d74d1de558e09b0) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:46.155125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7295e-ae8e-4d6f-8d0d-0353b48a420c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.158732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7295e-ae8e-4d6f-8d0d-0353b48a420c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.175814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 159/320] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 611 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:46.685333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac018b97-df10-4ceb-8692-afb542c9d10f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.685633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac018b97-df10-4ceb-8692-afb542c9d10f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.685959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac018b97-df10-4ceb-8692-afb542c9d10f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.688701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 162/321] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:46.696868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69f9c4-2378-493d-b291-ba8fc170c349 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.697477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69f9c4-2378-493d-b291-ba8fc170c349 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.697961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69f9c4-2378-493d-b291-ba8fc170c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.719158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0d69f9c4-2378-493d-b291-ba8fc170c349 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:46.720766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0d69f9c4-2378-493d-b291-ba8fc170c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:46.728889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 160/322] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:46.757681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac018b97-df10-4ceb-8692-afb542c9d10f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.772762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac018b97-df10-4ceb-8692-afb542c9d10f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.778162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.778999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.779287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.781519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.798042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:46.806178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:46.810588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 163/323] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:46.815286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69f9c4-2378-493d-b291-ba8fc170c349 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.826419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69f9c4-2378-493d-b291-ba8fc170c349 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.831145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.831816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.832161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.832438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.833297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:46.833654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.835272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.844776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 161/324] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:46.851629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.862897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba649a-7e92-4de6-b205-16b13dc21727 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.868008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.868657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.868944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.869277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.884341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.886474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.898204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 164/325] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:46.905623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.918038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421b300-11f8-4796-b7b6-b1674c626ed8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.922691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38820bb2-2c03-421e-b859-1ed0e5ecf077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.926189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820bb2-2c03-421e-b859-1ed0e5ecf077 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.926997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820bb2-2c03-421e-b859-1ed0e5ecf077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.927274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820bb2-2c03-421e-b859-1ed0e5ecf077 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.931906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38820bb2-2c03-421e-b859-1ed0e5ecf077 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.934400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38820bb2-2c03-421e-b859-1ed0e5ecf077 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.936316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 162/326] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:46.945671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:46.954763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40ed7-61b3-4358-8c8e-76a956675896 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.955136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40ed7-61b3-4358-8c8e-76a956675896 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.955356 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e40ed7-61b3-4358-8c8e-76a956675896 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.957877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 163/327] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:46.963714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0a245-f4ef-42b6-bb27-50c3fab43498 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:46.968722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a77aa-8347-4d5f-84bf-1af3df7267a5 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.969295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a77aa-8347-4d5f-84bf-1af3df7267a5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.969858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a77aa-8347-4d5f-84bf-1af3df7267a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.974134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:46.975926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:46.976435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:46.976935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:46.979292 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:46.983119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:46.986075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 165/328] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:46.995882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.003373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8f6a77aa-8347-4d5f-84bf-1af3df7267a5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:47.005238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8f6a77aa-8347-4d5f-84bf-1af3df7267a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:47.013621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868377-a0a1-4e45-9c23-ea0f1bb1011d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.016534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 164/329] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:47.021429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.021603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.022621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.022621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.024324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=3b38fac5719442ec8d74d1de558e09b0) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:47.024324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.025388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.032673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 166/330] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:46 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=3b38fac5719442ec8d74d1de558e09b0&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:47.051593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a77aa-8347-4d5f-84bf-1af3df7267a5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.067065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a77aa-8347-4d5f-84bf-1af3df7267a5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.075602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.076922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.077462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.077926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.093188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:47.111837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 16:35:47.114693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 165/331] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:47.123925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.142978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a736c18-98f2-4288-9fc6-e777789eb1d6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.147814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.148505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.148789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.149066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.149887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] RBAC: Adding query filter params (name=member) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:47.150190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.151853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.165319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 167/332] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:47.175114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.188113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38624f8-6c59-40ca-9d67-18b1fe62614f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.196492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.197649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.198120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.198598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.214481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.216640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.234823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 166/333] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:47.242764 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.253513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64c21c-960d-4aa9-a7d1-6e43b9056dec admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.262324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.263891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.264364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.264845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.270798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.274000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.276872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 168/334] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:47.284106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.294942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34922e-1c08-4ec7-885d-d3b74cc1fbee admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.302746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8925e5-e56a-4bbe-aa6c-1546f4d52ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.303673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8925e5-e56a-4bbe-aa6c-1546f4d52ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.303959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8925e5-e56a-4bbe-aa6c-1546f4d52ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.304234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8925e5-e56a-4bbe-aa6c-1546f4d52ebc admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.306291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8925e5-e56a-4bbe-aa6c-1546f4d52ebc admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.308668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8925e5-e56a-4bbe-aa6c-1546f4d52ebc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.311274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 167/335] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:47.318638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.336665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653dbb9-12bf-476d-a5e7-78915e3ef96e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.345920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33390165-c81c-49e1-86be-5c7fcae1b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.346604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390165-c81c-49e1-86be-5c7fcae1b437 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.346896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390165-c81c-49e1-86be-5c7fcae1b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.347180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390165-c81c-49e1-86be-5c7fcae1b437 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.348060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33390165-c81c-49e1-86be-5c7fcae1b437 admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=cc9b9740cce14af58694140b57aad8e3, scope.project.id=d33cbbd3852e4283836762f9edd90a57) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:47.348529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33390165-c81c-49e1-86be-5c7fcae1b437 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.350928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33390165-c81c-49e1-86be-5c7fcae1b437 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.358972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 169/336] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=cc9b9740cce14af58694140b57aad8e3 => generated 611 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:47.496330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab487c3-62fd-4e36-b67f-2962da3cd470 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.496617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab487c3-62fd-4e36-b67f-2962da3cd470 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.496901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab487c3-62fd-4e36-b67f-2962da3cd470 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.498800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 168/337] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:47.507330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fc854-1f2a-4157-8af0-0bf7da5b5784 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.507330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fc854-1f2a-4157-8af0-0bf7da5b5784 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.507330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fc854-1f2a-4157-8af0-0bf7da5b5784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.530003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6c0fc854-1f2a-4157-8af0-0bf7da5b5784 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:47.531581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6c0fc854-1f2a-4157-8af0-0bf7da5b5784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:47.543727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 170/338] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:47.569579 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab487c3-62fd-4e36-b67f-2962da3cd470 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.585847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab487c3-62fd-4e36-b67f-2962da3cd470 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.591085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.591849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.592158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.592433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.605295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:47.612857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:47.614326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 169/339] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:47.620839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fc854-1f2a-4157-8af0-0bf7da5b5784 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.630010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fc854-1f2a-4157-8af0-0bf7da5b5784 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.636990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.637751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.638136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.638447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.639241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:47.639543 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.641309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.652610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 171/340] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:47.658846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.670876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8515f-a3ec-4567-a6e1-d6e8251266c7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.675651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.676316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.676642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.676926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.688650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.690629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.702581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 170/341] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:47.709069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.721627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524a14e-1b52-43b2-9469-5f87b77afcfd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.726138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.726988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.727284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.727551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.728740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.730798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.732792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 172/342] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:47.738841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.749774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a6a8a-cf10-4735-a77f-314a14bf1b02 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.754282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb50bd-674e-42c6-b417-f3f927d29353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.755642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb50bd-674e-42c6-b417-f3f927d29353 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.755926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb50bd-674e-42c6-b417-f3f927d29353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.756201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb50bd-674e-42c6-b417-f3f927d29353 admin admin] PATH_INFO: `/v3/groups/925f602b99544e6abf80ef523b8dda2f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.757442 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb50bd-674e-42c6-b417-f3f927d29353 admin admin] RBAC: Authorizing `identity:get_group(group_id=925f602b99544e6abf80ef523b8dda2f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.759310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb50bd-674e-42c6-b417-f3f927d29353 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.760975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 171/343] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/groups/925f602b99544e6abf80ef523b8dda2f => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:47.767548 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:47.780593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040dd67-2447-4355-82f3-2ffb23b1ceee admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:47.785119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a704317-080e-4170-9075-8f47a64067bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:47.785852 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704317-080e-4170-9075-8f47a64067bb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:47.786170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704317-080e-4170-9075-8f47a64067bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:47.786449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704317-080e-4170-9075-8f47a64067bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:47.787300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a704317-080e-4170-9075-8f47a64067bb admin admin] RBAC: Adding query filter params (group.id=925f602b99544e6abf80ef523b8dda2f, role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=d33cbbd3852e4283836762f9edd90a57) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:47.787615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a704317-080e-4170-9075-8f47a64067bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:47.789486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a704317-080e-4170-9075-8f47a64067bb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:47.795977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 173/344] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:47 2021] GET /identity/v3/role_assignments?group.id=925f602b99544e6abf80ef523b8dda2f&scope.project.id=d33cbbd3852e4283836762f9edd90a57&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:48.148855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9b0d-2201-4767-bddb-1f66962aed8a None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.149397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9b0d-2201-4767-bddb-1f66962aed8a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.149488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9b0d-2201-4767-bddb-1f66962aed8a None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.151262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 172/345] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:48.157556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24b037-8697-4a28-af57-52fb9c08d670 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.158013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24b037-8697-4a28-af57-52fb9c08d670 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.158129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24b037-8697-4a28-af57-52fb9c08d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.176480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5b24b037-8697-4a28-af57-52fb9c08d670 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:48.178274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5b24b037-8697-4a28-af57-52fb9c08d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:48.185977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 174/346] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:48.211094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9b0d-2201-4767-bddb-1f66962aed8a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:48.222956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9b0d-2201-4767-bddb-1f66962aed8a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:48.227433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:48.228203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.228488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.228767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.238786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:48.246160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:35:48.247334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 173/347] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:35:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:48.253875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24b037-8697-4a28-af57-52fb9c08d670 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:48.263936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24b037-8697-4a28-af57-52fb9c08d670 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:48.268983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:48.269735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.270074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.270390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.271190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:48.271535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:48.273155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:48.281935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 175/348] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:48.288149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:48.298113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc185106-85c2-4399-b7fc-be5ea3e8322e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:48.302870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:48.303486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.303768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.304040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.311997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:48.313763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:48.322765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:48 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:48.329135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:48.338766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701b28c-126b-43ec-9cc5-a8f26fa94ac2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:48.343170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:48.344020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.344300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.344579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] PATH_INFO: `/v3/projects/64da0972f6f84075a0e8956810e3e6c1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.345806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] RBAC: Authorizing `identity:get_project(project_id=64da0972f6f84075a0e8956810e3e6c1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:48.347585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:48.349230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 176/350] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:35:48 2021] GET /identity/v3/projects/64da0972f6f84075a0e8956810e3e6c1 => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:48.355400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:48.364600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72416cc4-e4b2-4867-bfbf-72ca5e175114 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:48.369205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df9d7-6266-42a3-bf2c-87ec6e7492ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:48.370070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df9d7-6266-42a3-bf2c-87ec6e7492ff admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.370586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df9d7-6266-42a3-bf2c-87ec6e7492ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.370717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df9d7-6266-42a3-bf2c-87ec6e7492ff admin admin] PATH_INFO: `/v3/groups/bdbb57f5657746018343902edad1acb2` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.371814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df9d7-6266-42a3-bf2c-87ec6e7492ff admin admin] RBAC: Authorizing `identity:get_group(group_id=bdbb57f5657746018343902edad1acb2)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:48.373683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df9d7-6266-42a3-bf2c-87ec6e7492ff admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:48.375289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 175/351] 10.222.0.48 () {56 vars in 1201 bytes} [Tue Oct 12 16:35:48 2021] GET /identity/v3/groups/bdbb57f5657746018343902edad1acb2 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:48.382898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:48.392848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e6c1e-531b-4186-8cd6-07e4e17f68ae admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:48.397162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefdbfa-c38e-424c-a6e6-39c003cd7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:48.397847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefdbfa-c38e-424c-a6e6-39c003cd7aae admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:48.398132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefdbfa-c38e-424c-a6e6-39c003cd7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:48.398410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefdbfa-c38e-424c-a6e6-39c003cd7aae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:48.399253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefdbfa-c38e-424c-a6e6-39c003cd7aae admin admin] RBAC: Adding query filter params (group.id=bdbb57f5657746018343902edad1acb2, role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=64da0972f6f84075a0e8956810e3e6c1) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:48.399565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefdbfa-c38e-424c-a6e6-39c003cd7aae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:48.401400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefdbfa-c38e-424c-a6e6-39c003cd7aae admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:48.407034 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 177/352] 10.222.0.48 () {56 vars in 1397 bytes} [Tue Oct 12 16:35:48 2021] GET /identity/v3/role_assignments?group.id=bdbb57f5657746018343902edad1acb2&scope.project.id=64da0972f6f84075a0e8956810e3e6c1&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:51.109770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463defd9-f420-402d-beb3-7b1de3519d7c None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.110343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463defd9-f420-402d-beb3-7b1de3519d7c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.110343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463defd9-f420-402d-beb3-7b1de3519d7c None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.112289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 176/353] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:51.131968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56327c34-3a13-49ed-bced-bfad2b55469a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.132608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56327c34-3a13-49ed-bced-bfad2b55469a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.132840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56327c34-3a13-49ed-bced-bfad2b55469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.153025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-56327c34-3a13-49ed-bced-bfad2b55469a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:51.154243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-56327c34-3a13-49ed-bced-bfad2b55469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:51.167649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 178/354] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:51.213185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463defd9-f420-402d-beb3-7b1de3519d7c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:51.231280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463defd9-f420-402d-beb3-7b1de3519d7c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:51.238292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:51.239073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.239874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.240161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.254596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:51.256979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:51.280069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:51.281270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 177/355] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:51.287998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56327c34-3a13-49ed-bced-bfad2b55469a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:51.297442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56327c34-3a13-49ed-bced-bfad2b55469a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:51.306038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:51.306716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.307002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.307282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.308037 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:51.308344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:51.309387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:51.309387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:51.309387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:51.310282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a1b9b-b079-4190-9c50-6daf4cde6017 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:51.341304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 179/356] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:51.347592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:51.362888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada7d60-6bff-4bb3-aa18-6ff9f9faee1d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:51.368053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c643f-fead-4445-a041-ade6b6384722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:51.368733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c643f-fead-4445-a041-ade6b6384722 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.369014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c643f-fead-4445-a041-ade6b6384722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.369291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c643f-fead-4445-a041-ade6b6384722 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.370073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c643f-fead-4445-a041-ade6b6384722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:51.371102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-f84c643f-fead-4445-a041-ade6b6384722 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:51.371102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:51.371102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:51.372326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c643f-fead-4445-a041-ade6b6384722 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:51.419233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 178/357] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:35:51 2021] POST /identity/v3/users => generated 246 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:51.521655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7adaf-d0cd-4acc-9afa-15e973b874ea None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.521958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7adaf-d0cd-4acc-9afa-15e973b874ea None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.522156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7adaf-d0cd-4acc-9afa-15e973b874ea None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.524079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 180/358] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:51.530403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051bf1a-5567-49f2-9fd8-189f48884504 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.530719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051bf1a-5567-49f2-9fd8-189f48884504 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.530972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051bf1a-5567-49f2-9fd8-189f48884504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.554848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b051bf1a-5567-49f2-9fd8-189f48884504 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:51.556070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b051bf1a-5567-49f2-9fd8-189f48884504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:51.569302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 179/359] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:51.619652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7adaf-d0cd-4acc-9afa-15e973b874ea None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:51.636049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7adaf-d0cd-4acc-9afa-15e973b874ea None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:51.643573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:51.644403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.644688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.644971 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.657361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:51.659495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:51.683883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:51.685499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 181/360] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:51.691762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051bf1a-5567-49f2-9fd8-189f48884504 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:51.712863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051bf1a-5567-49f2-9fd8-189f48884504 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:51.721925 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe651736-28cf-4949-818f-89795dda5a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:51.722609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe651736-28cf-4949-818f-89795dda5a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.722891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe651736-28cf-4949-818f-89795dda5a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.723163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe651736-28cf-4949-818f-89795dda5a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.724466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe651736-28cf-4949-818f-89795dda5a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:51.724774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe651736-28cf-4949-818f-89795dda5a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:51.726465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe651736-28cf-4949-818f-89795dda5a4b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:51.749001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 180/361] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:51.753904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:51.767329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403a1c5-0043-46d4-a5f9-698b7e4989f7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:51.776038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489f932-6cb3-4db3-9077-d382b6a19930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:51.776655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489f932-6cb3-4db3-9077-d382b6a19930 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.776942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489f932-6cb3-4db3-9077-d382b6a19930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.777223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489f932-6cb3-4db3-9077-d382b6a19930 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.778018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489f932-6cb3-4db3-9077-d382b6a19930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:51.779935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489f932-6cb3-4db3-9077-d382b6a19930 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:51.803761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 182/362] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:35:51 2021] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:51.882595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4e206-bbcd-411e-be5e-072f99365bb0 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.882936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4e206-bbcd-411e-be5e-072f99365bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.883216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4e206-bbcd-411e-be5e-072f99365bb0 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.885501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 181/363] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:51.892334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee624-11a1-40a1-91b3-78a93ae36c41 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.892666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee624-11a1-40a1-91b3-78a93ae36c41 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.892908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ee624-11a1-40a1-91b3-78a93ae36c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:51.912795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-937ee624-11a1-40a1-91b3-78a93ae36c41 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:51.914059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-937ee624-11a1-40a1-91b3-78a93ae36c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:51.926039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 183/364] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:51.953202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4e206-bbcd-411e-be5e-072f99365bb0 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:51.971112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4e206-bbcd-411e-be5e-072f99365bb0 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:51.978250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:51.979420 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:51.980046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:51.980751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.001962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.004335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.030491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:52.032424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 182/365] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:52.039995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ee624-11a1-40a1-91b3-78a93ae36c41 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.054947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ee624-11a1-40a1-91b3-78a93ae36c41 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.062465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c849e5d-d159-4dde-8b05-f1e3150563de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.063136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c849e5d-d159-4dde-8b05-f1e3150563de admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.063422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c849e5d-d159-4dde-8b05-f1e3150563de admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.063703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c849e5d-d159-4dde-8b05-f1e3150563de admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.064448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c849e5d-d159-4dde-8b05-f1e3150563de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:52.064759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c849e5d-d159-4dde-8b05-f1e3150563de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.066474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c849e5d-d159-4dde-8b05-f1e3150563de admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.087569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 184/366] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:52.096616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.113709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3171e-c063-4476-b0f1-58ed9a33526e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.121261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace25a1-cbbf-43bf-b03c-da8d215682e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.122669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace25a1-cbbf-43bf-b03c-da8d215682e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.123397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace25a1-cbbf-43bf-b03c-da8d215682e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.124130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace25a1-cbbf-43bf-b03c-da8d215682e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.127022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace25a1-cbbf-43bf-b03c-da8d215682e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.130496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace25a1-cbbf-43bf-b03c-da8d215682e3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.164422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 183/367] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:35:52 2021] POST /identity/v3/users => generated 248 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:52.328198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbcf48-caa1-4f54-8c74-8b4b92e262b1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.328933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbcf48-caa1-4f54-8c74-8b4b92e262b1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.328933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbcf48-caa1-4f54-8c74-8b4b92e262b1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.330825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 185/368] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:52.338730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94a60a-53b8-49b4-9cea-7f625b660e1c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.339647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94a60a-53b8-49b4-9cea-7f625b660e1c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.340322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94a60a-53b8-49b4-9cea-7f625b660e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.370972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-6d94a60a-53b8-49b4-9cea-7f625b660e1c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:52.373313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6d94a60a-53b8-49b4-9cea-7f625b660e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:52.389169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 184/369] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:52.418015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbcf48-caa1-4f54-8c74-8b4b92e262b1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.433869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbcf48-caa1-4f54-8c74-8b4b92e262b1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.441688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.442498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.443327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.443608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.463805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.465695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.489364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:52.491059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 186/370] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:52.498297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94a60a-53b8-49b4-9cea-7f625b660e1c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.511865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94a60a-53b8-49b4-9cea-7f625b660e1c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.522919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ccf55-f8e6-4a8c-b493-7c5b076438b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.524045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ccf55-f8e6-4a8c-b493-7c5b076438b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.524568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ccf55-f8e6-4a8c-b493-7c5b076438b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.525049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ccf55-f8e6-4a8c-b493-7c5b076438b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.526095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ccf55-f8e6-4a8c-b493-7c5b076438b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:52.526637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ccf55-f8e6-4a8c-b493-7c5b076438b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.528498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ccf55-f8e6-4a8c-b493-7c5b076438b2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.549719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 185/371] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:52.556742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.567415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e026c-0251-4439-8c90-2afca2865c2a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.576675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b2e7-5d02-47c0-9a65-8e2e8d2ddd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.577364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b2e7-5d02-47c0-9a65-8e2e8d2ddd6c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.577668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b2e7-5d02-47c0-9a65-8e2e8d2ddd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.577943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b2e7-5d02-47c0-9a65-8e2e8d2ddd6c admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.578728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99b2e7-5d02-47c0-9a65-8e2e8d2ddd6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.580606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99b2e7-5d02-47c0-9a65-8e2e8d2ddd6c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.608472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 187/372] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:35:52 2021] POST /identity/v3/users => generated 249 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:52.679453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0af6f4-febc-497c-96f6-995bf7c666dd None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.680146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0af6f4-febc-497c-96f6-995bf7c666dd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.681080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0af6f4-febc-497c-96f6-995bf7c666dd None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.684075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 186/373] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:52.690488 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5447-147a-49c6-8f1e-62ed9da5b80c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.690791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5447-147a-49c6-8f1e-62ed9da5b80c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.691054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e5447-147a-49c6-8f1e-62ed9da5b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.718659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-465e5447-147a-49c6-8f1e-62ed9da5b80c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:52.719941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-465e5447-147a-49c6-8f1e-62ed9da5b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:52.728957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 188/374] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:52.755810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0af6f4-febc-497c-96f6-995bf7c666dd None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.782235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0af6f4-febc-497c-96f6-995bf7c666dd None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.790224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.790930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.791218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.791498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.792298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.793333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:52.793333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:52.793333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:52.794252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.803744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.sql.core [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 16:35:52.803744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 16:35:52.803744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [parameters: {'id': 'edbdcf33965d49adb551ec9cbe8e4bbd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 16:35:52.803744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80071) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:35:52.819147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 16:35:52.820980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 187/375] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:35:52 2021] POST /identity/v3/roles => generated 144 bytes in 66 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:52.827681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e5447-147a-49c6-8f1e-62ed9da5b80c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.839110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e5447-147a-49c6-8f1e-62ed9da5b80c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.845821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db074079-fadf-4d7f-a205-62a6a6437c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.846695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db074079-fadf-4d7f-a205-62a6a6437c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.846979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db074079-fadf-4d7f-a205-62a6a6437c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.847257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db074079-fadf-4d7f-a205-62a6a6437c04 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.863995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db074079-fadf-4d7f-a205-62a6a6437c04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:52.872105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-db074079-fadf-4d7f-a205-62a6a6437c04 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 16:35:52.874010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 189/376] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:35:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:52.880226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:52.891752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6474c23-2850-4f04-9af4-bb3c5b32f301 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:52.896893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf626b-c40c-4821-b358-597c8d4f46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:52.897591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf626b-c40c-4821-b358-597c8d4f46a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:52.897969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf626b-c40c-4821-b358-597c8d4f46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:52.898411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf626b-c40c-4821-b358-597c8d4f46a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:52.899421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf626b-c40c-4821-b358-597c8d4f46a5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:52.899743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf626b-c40c-4821-b358-597c8d4f46a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:52.901365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf626b-c40c-4821-b358-597c8d4f46a5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:52.911505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 188/377] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:54.466647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d9316-f806-424c-8412-2ddc7aa28f5b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.467673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d9316-f806-424c-8412-2ddc7aa28f5b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.468166 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d9316-f806-424c-8412-2ddc7aa28f5b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.470519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 190/378] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:54.476710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f13b-28b4-4690-a52f-6f56f59472a1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.477758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f13b-28b4-4690-a52f-6f56f59472a1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.478258 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f13b-28b4-4690-a52f-6f56f59472a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.502461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ad98f13b-28b4-4690-a52f-6f56f59472a1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:54.504047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ad98f13b-28b4-4690-a52f-6f56f59472a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:54.516704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 189/379] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:54.542107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d9316-f806-424c-8412-2ddc7aa28f5b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:54.562105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d9316-f806-424c-8412-2ddc7aa28f5b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:54.566685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:54.567496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.568308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.568606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.591454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:54.598567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:54.605521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 191/380] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:54.607158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f13b-28b4-4690-a52f-6f56f59472a1 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:54.621022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f13b-28b4-4690-a52f-6f56f59472a1 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:54.633071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:54.634178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.634719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.635216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.636244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:54.636767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:54.638663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:54.651704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 190/381] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:54.658106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:54.670622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5f60b-5e17-41e3-b448-f4b469b9845d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:54.681713 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:54.682533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.682818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.683095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.705939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:54.707802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:54.728783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:54.735735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 192/382] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:54.737101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:54.753135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738fcd9-2384-4878-97e0-a24b8ea6fd04 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:54.766640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:54.767701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.768254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.768785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.769767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:54.770286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:54.772711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:54.792909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 191/383] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:54.799159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:54.814310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03449a-e0c4-4114-9273-34a142b3cfed admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:54.825403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:54.826202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.826487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.826765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.846905 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:54.849012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:54.868415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:35:54.869697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 193/384] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:35:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:54.876280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:54.895864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c88707-fca9-4386-a175-255d12794bdd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:54.901190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:54.902291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:54.902786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:54.903293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:54.904383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:54.904940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:54.906290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:54.906290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:54.906290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:54.907914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157ce92-b832-43b6-9192-30e978a8e57f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:54.978059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 192/385] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:35:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:54.984421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.003931 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734ad0-87d4-4253-a430-004e0926811c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.014565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360795fc-5f0c-4d64-8fd7-780e9c4299f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.015234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360795fc-5f0c-4d64-8fd7-780e9c4299f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.015518 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360795fc-5f0c-4d64-8fd7-780e9c4299f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.015736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b228-3324-4d64-abd5-e93396de355a None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.015841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360795fc-5f0c-4d64-8fd7-780e9c4299f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.016038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b228-3324-4d64-abd5-e93396de355a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.016325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99b228-3324-4d64-abd5-e93396de355a None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.018416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 193/386] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:55.025398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985a626-bc34-4baa-a480-8461ae543ece None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.025701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985a626-bc34-4baa-a480-8461ae543ece None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.025987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985a626-bc34-4baa-a480-8461ae543ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.030452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360795fc-5f0c-4d64-8fd7-780e9c4299f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.032217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360795fc-5f0c-4d64-8fd7-780e9c4299f5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.058078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 194/387] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:55.059057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c985a626-bc34-4baa-a480-8461ae543ece None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:55.060343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c985a626-bc34-4baa-a480-8461ae543ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:55.063058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c23c8a-6237-4106-b8f9-b434e336fb13 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.063353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c23c8a-6237-4106-b8f9-b434e336fb13 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.063640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c23c8a-6237-4106-b8f9-b434e336fb13 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.069756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 195/388] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:55 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:55.070612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c23c8a-6237-4106-b8f9-b434e336fb13 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.072966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 194/389] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:55.074571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4799-1d07-424d-bcbd-02e53ee670d5 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.075132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4799-1d07-424d-bcbd-02e53ee670d5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.075427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f4799-1d07-424d-bcbd-02e53ee670d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.091145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c23c8a-6237-4106-b8f9-b434e336fb13 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.100199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-cc0f4799-1d07-424d-bcbd-02e53ee670d5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:55.102189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.103412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-cc0f4799-1d07-424d-bcbd-02e53ee670d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:55.103968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.104225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.104505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.115780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 195/390] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:55.116370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4799-1d07-424d-bcbd-02e53ee670d5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.124029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.126014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.135561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f4799-1d07-424d-bcbd-02e53ee670d5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.143962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.144791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.145069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.145433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.154499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:55.156013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 196/391] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.156788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.157613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:55.169107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:55.170352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 196/392] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.171116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.173802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c04c4-d651-4a16-9676-82a41a1e4f5b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.181847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6759fc-b9b7-4b13-8b6b-7a0dced07b4a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.185809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.186151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.186369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.186572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.186799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.187016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.187259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.187463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.190143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.190143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.190710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.200458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:55.204113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 197/393] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.204942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.213979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:55.215445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.216348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.220073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf227b62-aa03-4832-8220-6b9f95620dfb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.225456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.226348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.226847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.227315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.228269 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.228777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.230581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.232260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34829439-ca09-41e9-8afe-9752929ab15b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.236988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.237879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.238169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.238502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.242308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 198/395] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.243403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.246932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.249002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.254077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928345d2-39d8-40e8-aba5-615b5e237bc4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.260464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.261723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.262220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.262705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.263654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.264166 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:35:55.264377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.265436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.266272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.266780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.276892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 199/397] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.278606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ab7d0-f1e0-40c5-a30b-ae4e16c4f3b0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.279625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.289617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.290391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.290729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.291009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.293861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3be54f-a188-449f-8909-57b8d2aaa8f3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.298484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.299359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.299856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.300324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.301312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.301864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.303105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:55.303105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:35:55.303105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:35:55.303780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.304984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.305777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.324689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:55.331174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 199/399] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.331174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.331400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 200/399] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.333205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.341771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebda5f4-8c6a-4559-9a16-78dd2da3104a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.345246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0a724-8f84-4687-8135-455ff0262531 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.346585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.347516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.347908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.348281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.350918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.351745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.352173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.352595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.353633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=da3ce1b443aa425c99aab2ca8e6b53c8) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.354087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.356131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.360849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.369395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.369586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 201/400] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/role_assignments?user.id=da3ce1b443aa425c99aab2ca8e6b53c8&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.370305 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.392977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea7e2-7e67-4626-bf1e-53ff42f5a9bf admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.405403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:55.406639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 200/401] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.407299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.408217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.408708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.409179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.410178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.410736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.412626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.426113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 202/402] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.430185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.435952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.452113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bed17-86b5-4d6a-86ba-f8e4b1cb65e2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.453570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326135f4-3514-45db-a5e4-8aec1faa50c7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.463594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.464591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.466117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.466704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.467195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.468015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.468509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.468989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.470116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.471599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.475170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.484809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.492137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.504867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 201/403] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.517808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:35:55.522179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 203/404] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/users/glance => generated 84 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:55.524402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.538569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.549194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9f2a9-07a6-46b7-91e8-d7d993b3229d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.549683 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389636b3-50f9-4af7-a017-55126f191bd1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.555407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.556422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.556901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.557417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.558612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.559191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.561546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.570608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.572180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.572674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.573150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.587591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 204/405] 10.222.0.48 () {56 vars in 1158 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:55.599908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.603798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.607205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.622912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f1420-f9b8-4e5c-a03f-e48e959948a9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.630240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:35:55.633420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 202/406] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/users/cinder => generated 84 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:55.639605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.648928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5a19b-1659-4c4a-bf01-f15b9447b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.650203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a19b-1659-4c4a-bf01-f15b9447b46f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.652513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf10fda-ca7c-4b8c-ba9a-a1776c728e0f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.653038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a19b-1659-4c4a-bf01-f15b9447b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.653544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5a19b-1659-4c4a-bf01-f15b9447b46f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.665289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.665725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a19b-1659-4c4a-bf01-f15b9447b46f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.666474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.666952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.667497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5a19b-1659-4c4a-bf01-f15b9447b46f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.667601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.668631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.669123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.670412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:55.670412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:55.670412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:55.672058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae09f48-ba33-4027-8bc8-246725e56d87 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.677052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 205/407] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:55.678409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b0e7-7af8-4bee-a66a-e19246e7420a None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.678706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b0e7-7af8-4bee-a66a-e19246e7420a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.679082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b0e7-7af8-4bee-a66a-e19246e7420a None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.681072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 206/408] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:55.686779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796b0e7-7af8-4bee-a66a-e19246e7420a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.699227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796b0e7-7af8-4bee-a66a-e19246e7420a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.704101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.704932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.705217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.705529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.717821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.719758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.725648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 203/409] 10.222.0.48 () {56 vars in 1158 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.727935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273503-a1e7-47a6-ab51-cee3271949cf None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.728212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273503-a1e7-47a6-ab51-cee3271949cf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.728495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21273503-a1e7-47a6-ab51-cee3271949cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.748135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-21273503-a1e7-47a6-ab51-cee3271949cf None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:55.749282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-21273503-a1e7-47a6-ab51-cee3271949cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:55.757200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 204/410] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:55.758470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273503-a1e7-47a6-ab51-cee3271949cf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.784143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21273503-a1e7-47a6-ab51-cee3271949cf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.798830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.799500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.799793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.800063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.809186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.811045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.826577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 205/411] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:35:55.826577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.839840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f62cc-04dc-4c7a-ae84-a35000261096 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.844978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.846133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.846678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.847193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.861201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:55.866620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:55.868177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 207/412] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.868965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.869907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:55.871308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 206/413] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.874051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.884227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dcd213-7561-486a-b6a7-ecba94bbb94a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.886732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02d4c2-0a99-495e-8c17-bea4bf6b7349 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.888793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.889599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.889888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.890164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.893412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.894339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.894834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.895356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.896958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.897501 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.900270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.901772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.903599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.915834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 207/414] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:55.917084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.921428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:55.927401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 208/415] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.927401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.936073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aabd33-17eb-48f1-9699-e696d914e497 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.939806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48a3a-fe5b-4546-95c8-704b94eaab82 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.940607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.941262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.941639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.941915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.942851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.943711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.945647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.946539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.947765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.948613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.949087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.955303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 208/416] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:55.959316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.961724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.962174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.971481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004b99d-7378-4664-8780-54806e44b122 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:55.976912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:55.977605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:55.977935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:55.978216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:55.978946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:55.979306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:55.979406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:35:55.980799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 209/417] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:55.981319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:55.982194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:55.994378 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0820eab-650c-4fe0-9326-ddc8c5a629d5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.000689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 209/418] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.000689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.006053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.007013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.007728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.008189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.013077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896fde6-d9ea-4a86-af04-281639f37c0b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.017871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.018681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.019060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.019439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.020684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.020684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.022531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:35:56.022531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:35:56.022531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:35:56.023869 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.024423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.026041 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.043077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 210/419] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.044031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.045341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:56.046707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 210/420] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:56.050681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.060182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1477f4d-21b3-4b3e-b4a8-73e3e110d3d5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.063753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72fd54-368c-4bfc-b838-621044b745eb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.065069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.066140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.066680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.067147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.068983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.069662 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.070032 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.070217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.071273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=6c767d4a9ad7459880884eb8c546dc55) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.071591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.073832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.078031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.080307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.080852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 211/421] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/role_assignments?user.id=6c767d4a9ad7459880884eb8c546dc55&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.086470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.108562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:35:56.111533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5403-7490-4987-9456-fecd81ceefc9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.114503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 211/422] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:56.119016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.120169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.120686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.121961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.123372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.126394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.130300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.132958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.143644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb48c34-f18d-46a6-827c-047aa508b6c4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.153657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 212/423] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.162830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.164081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.164629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.165100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.166181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.167543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.168985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.173964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.184677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79569aa-df48-47fc-b8c8-00c12d46f870 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.196300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7a3a8-6917-4d73-b963-9a0e8fbd2d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.197538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a3a8-6917-4d73-b963-9a0e8fbd2d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.198371 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a3a8-6917-4d73-b963-9a0e8fbd2d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.198841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7a3a8-6917-4d73-b963-9a0e8fbd2d16 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.203443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 212/424] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.211660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.217791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7a3a8-6917-4d73-b963-9a0e8fbd2d16 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.223567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7a3a8-6917-4d73-b963-9a0e8fbd2d16 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.237210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeb3f6-3795-47a0-a0d8-673b9505bde8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.246804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456be43d-1e12-42dc-aa73-4b5f22eac55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.247862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456be43d-1e12-42dc-aa73-4b5f22eac55c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.249819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456be43d-1e12-42dc-aa73-4b5f22eac55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.250112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456be43d-1e12-42dc-aa73-4b5f22eac55c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.251097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456be43d-1e12-42dc-aa73-4b5f22eac55c admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=9e128ed2736b4158ae2009df5ba23fe6) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.251359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456be43d-1e12-42dc-aa73-4b5f22eac55c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.252984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-16a7a3a8-6917-4d73-b963-9a0e8fbd2d16 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:35:56.253261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456be43d-1e12-42dc-aa73-4b5f22eac55c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.254786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 213/425] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/users/neutron => generated 85 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:56.256934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd49dd-4a2b-4a5a-a8bf-4a17aa8993da None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.257635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd49dd-4a2b-4a5a-a8bf-4a17aa8993da None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.258213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd49dd-4a2b-4a5a-a8bf-4a17aa8993da None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.260329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 214/426] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:56.262414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd49dd-4a2b-4a5a-a8bf-4a17aa8993da None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.265333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 213/427] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/role_assignments?user.id=9e128ed2736b4158ae2009df5ba23fe6&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.267576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e615-fb6c-4004-a278-14bb249929a2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.267868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e615-fb6c-4004-a278-14bb249929a2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.268149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0e615-fb6c-4004-a278-14bb249929a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.298016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-42e0e615-fb6c-4004-a278-14bb249929a2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:56.299795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-42e0e615-fb6c-4004-a278-14bb249929a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:56.306186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd49dd-4a2b-4a5a-a8bf-4a17aa8993da None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.310739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 214/428] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:56.320675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.320914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.320999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.321284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.322183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.322498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.324392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.338483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e615-fb6c-4004-a278-14bb249929a2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.347844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0e615-fb6c-4004-a278-14bb249929a2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.350472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 215/429] 10.222.0.48 () {56 vars in 1160 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.357352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.359769 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.360590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.360885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.361166 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.370128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74251f0b-1904-420d-86f1-b4dc5a6e1168 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.375127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.376400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.377122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.377836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.378384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.378978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.389607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.391864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.398123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:56.399547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 215/430] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:35:56.404944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 216/431] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:35:56.407401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.411550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.420173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cb5bf-95a6-444e-92fe-b1c24d48ac03 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.423186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb650ac8-b2d8-4bd1-8ec3-091c07ab1bbe admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.426110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.427902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.428381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.428715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.429178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.429432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.429565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.429815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.431252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.431783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.433839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.442784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.446112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.453746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 216/432] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:56.456649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.466441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:56.467699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 217/433] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:56.468374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4ea8b-6bdb-4a41-a65d-7c499cc13724 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.474323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.475487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.476461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.477006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.477629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.478723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.481076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.484562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c166a-dc2a-45f3-88b4-89446270e471 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.489205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.490534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.490826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.491140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.492178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.492491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.495013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.518511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 218/435] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:56.524520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 217/435] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:35:56 2021] POST /identity/v3/users => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:35:56.525969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.537347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd880f5-0e16-4e13-b86b-34132d734906 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.543231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.544474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.545192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.545848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.555995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.558797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.575692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:35:56.577426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 219/436] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:56.583977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.595290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ce0a0-5f5e-477a-a618-cf7b7945b362 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.600611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89c936-3065-4898-b920-9daad0151d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.601970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89c936-3065-4898-b920-9daad0151d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.602554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89c936-3065-4898-b920-9daad0151d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.603138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89c936-3065-4898-b920-9daad0151d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.604237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89c936-3065-4898-b920-9daad0151d17 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.604777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89c936-3065-4898-b920-9daad0151d17 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.607019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89c936-3065-4898-b920-9daad0151d17 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.622825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 218/437] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:56.630568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:56.644624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838711e4-4e31-437f-9c37-87ec0ef72af2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:56.653337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2cb2e-1693-42e6-af99-37f500c5678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:56.654550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2cb2e-1693-42e6-af99-37f500c5678f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:56.655072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2cb2e-1693-42e6-af99-37f500c5678f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:56.655634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2cb2e-1693-42e6-af99-37f500c5678f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:56.656726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2cb2e-1693-42e6-af99-37f500c5678f admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=671f4f6ff7d84739aecf74e53bb1aba5) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:56.657256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2cb2e-1693-42e6-af99-37f500c5678f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:56.659545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2cb2e-1693-42e6-af99-37f500c5678f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:56.667964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 220/438] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:35:56 2021] GET /identity/v3/role_assignments?user.id=671f4f6ff7d84739aecf74e53bb1aba5&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:58.241038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544d55f-4990-4365-851e-48469ba8f74b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.242079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544d55f-4990-4365-851e-48469ba8f74b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.242572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544d55f-4990-4365-851e-48469ba8f74b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.244959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 219/439] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:58.251671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af54c43-f753-43b4-bf9e-b43a7414b71d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.252620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af54c43-f753-43b4-bf9e-b43a7414b71d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.253113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af54c43-f753-43b4-bf9e-b43a7414b71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.280422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5af54c43-f753-43b4-bf9e-b43a7414b71d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:58.282969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5af54c43-f753-43b4-bf9e-b43a7414b71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:58.294507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 221/440] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:58.319631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544d55f-4990-4365-851e-48469ba8f74b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.333494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544d55f-4990-4365-851e-48469ba8f74b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.338538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.339634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.340130 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.340606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.353274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:58.360595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:58.362516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 220/441] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:58.369819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af54c43-f753-43b4-bf9e-b43a7414b71d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.379840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af54c43-f753-43b4-bf9e-b43a7414b71d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.384897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.385844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.386356 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.386829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.387806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:58.388398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.390249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.403797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 222/442] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:58.410351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.421476 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181800-e416-4096-9d00-8c74551ad7cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.426493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.428261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.428867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.429441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.442632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.444925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.465678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:58.467582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 221/443] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:58.474008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.488912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ce8b-f5a7-44cb-a74e-bfc0e814532c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.494591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.495496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.496007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.496500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.501597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:58.502186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.504059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.526918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 223/444] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:58.533263 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.550530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cadaa-b3d5-4618-8f47-4dd50c9f5c74 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.556251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.557343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.557927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.558576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.570902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.573300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.592327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:35:58.594215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 222/445] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:58.600553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.613653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e320de-3635-4fa0-b8e3-4cfa47b452c2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.618713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.619668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.620175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.620648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.621761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:58.622315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.624438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.649616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 224/446] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:35:58.655694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.666563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932078c-c5a8-4de5-b208-1f226850f599 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.676410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.677597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.678085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.678615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.691095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.693308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.712244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:58.714194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 223/447] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:58.719882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.734393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8be60-3b32-4902-975b-0869aa20cda8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.739386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.740382 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.740878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.741408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.742439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:58.743236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.745692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.764247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 225/448] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:58.770299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.781163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc288e5-d82d-4490-83c2-c13775cd784e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.789770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.790839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.791363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.791840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.799625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.805384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.820217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:35:58.827231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 224/449] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:58.834458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.846922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d0913-283d-4653-b51f-e15628f72584 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.853997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171a5d2-392d-4faa-bbd3-52efd3698150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.855127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a5d2-392d-4faa-bbd3-52efd3698150 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.855615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a5d2-392d-4faa-bbd3-52efd3698150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.856100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171a5d2-392d-4faa-bbd3-52efd3698150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.857158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171a5d2-392d-4faa-bbd3-52efd3698150 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:58.857709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171a5d2-392d-4faa-bbd3-52efd3698150 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.859914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171a5d2-392d-4faa-bbd3-52efd3698150 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.880536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 226/450] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:35:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:58.887009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:58.897938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cdea54-cf57-4cab-8668-1e86d2aa4a97 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:58.909610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374cdbb-748b-414e-995a-395613d80ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:58.910906 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374cdbb-748b-414e-995a-395613d80ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:58.911393 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374cdbb-748b-414e-995a-395613d80ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:58.911937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374cdbb-748b-414e-995a-395613d80ace admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/da3ce1b443aa425c99aab2ca8e6b53c8/roles/b0384dab922047ac99e3d88dcd0535a3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:58.934128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374cdbb-748b-414e-995a-395613d80ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=da3ce1b443aa425c99aab2ca8e6b53c8, role_id=b0384dab922047ac99e3d88dcd0535a3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:58.936813 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374cdbb-748b-414e-995a-395613d80ace admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:58.966379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 225/451] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:58 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/da3ce1b443aa425c99aab2ca8e6b53c8/roles/b0384dab922047ac99e3d88dcd0535a3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:35:59.016182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e255f9-6000-4a49-9988-1824a5607c4a None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.016780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e255f9-6000-4a49-9988-1824a5607c4a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.017259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e255f9-6000-4a49-9988-1824a5607c4a None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.019702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 227/452] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:59.026596 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06b11-416c-4585-bb16-5f00d8c59766 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.026921 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06b11-416c-4585-bb16-5f00d8c59766 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.027185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06b11-416c-4585-bb16-5f00d8c59766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.054603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f3d06b11-416c-4585-bb16-5f00d8c59766 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:59.055850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f3d06b11-416c-4585-bb16-5f00d8c59766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:59.140104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 226/453] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:59.179317 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e255f9-6000-4a49-9988-1824a5607c4a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.201364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e255f9-6000-4a49-9988-1824a5607c4a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.210058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.211539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.212029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.212505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.228065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:59.235702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:59.237716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 228/454] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.244888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d06b11-416c-4585-bb16-5f00d8c59766 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.258984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d06b11-416c-4585-bb16-5f00d8c59766 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.274327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2486a6d-74a0-4361-8bf1-5654ae08ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.274947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486a6d-74a0-4361-8bf1-5654ae08ff8e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.275231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486a6d-74a0-4361-8bf1-5654ae08ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.275514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2486a6d-74a0-4361-8bf1-5654ae08ff8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.276295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486a6d-74a0-4361-8bf1-5654ae08ff8e admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.276603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486a6d-74a0-4361-8bf1-5654ae08ff8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.278260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2486a6d-74a0-4361-8bf1-5654ae08ff8e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.288073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 227/455] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.294408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.307502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268a28-6729-4178-bf42-0d9231884f36 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.313331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.314532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.314992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.315464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.333322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.336270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.356875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:59.358483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ee32-1b1b-40d3-b9af-191e0e8e2aad None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.358817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 229/456] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.358925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ee32-1b1b-40d3-b9af-191e0e8e2aad None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.359339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9ee32-1b1b-40d3-b9af-191e0e8e2aad None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.361322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 228/457] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:59.367486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.369038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66e58-aaa4-4ec4-932d-872a6cdbb8af None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.369583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66e58-aaa4-4ec4-932d-872a6cdbb8af None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.370063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66e58-aaa4-4ec4-932d-872a6cdbb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.385603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c140e-d501-4601-b3f9-49fc22480759 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.394443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b3a66e58-aaa4-4ec4-932d-872a6cdbb8af None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:59.395660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b3a66e58-aaa4-4ec4-932d-872a6cdbb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:59.397734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.399777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.400265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.400670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.401479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.401845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.403524 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.420223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 229/458] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:59.431880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 230/459] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.437882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66e58-aaa4-4ec4-932d-872a6cdbb8af None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.445972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.454576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66e58-aaa4-4ec4-932d-872a6cdbb8af None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.461393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d79c4-15af-4321-a563-add999072ec5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.463608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af920fb-7961-47c7-ab11-608720077762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.464410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af920fb-7961-47c7-ab11-608720077762 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.464693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af920fb-7961-47c7-ab11-608720077762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.465040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af920fb-7961-47c7-ab11-608720077762 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.466664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f05165-adc0-4eee-a94f-6ed3dcc83e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.467804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05165-adc0-4eee-a94f-6ed3dcc83e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.468242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05165-adc0-4eee-a94f-6ed3dcc83e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.468522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f05165-adc0-4eee-a94f-6ed3dcc83e59 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.473218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af920fb-7961-47c7-ab11-608720077762 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.476111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af920fb-7961-47c7-ab11-608720077762 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.480356 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f05165-adc0-4eee-a94f-6ed3dcc83e59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:59.487343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e4f05165-adc0-4eee-a94f-6ed3dcc83e59 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:59.488868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 231/460] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.490255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248fe4-257c-44ba-8473-cd63aba2b3b1 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.490558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248fe4-257c-44ba-8473-cd63aba2b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.490843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248fe4-257c-44ba-8473-cd63aba2b3b1 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.492336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-6af920fb-7961-47c7-ab11-608720077762 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:35:59.492816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 232/461] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:59.499653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 230/462] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.499799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248fe4-257c-44ba-8473-cd63aba2b3b1 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.501112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121396-a1d3-4c65-af65-f3856567da83 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.501892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121396-a1d3-4c65-af65-f3856567da83 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.503073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121396-a1d3-4c65-af65-f3856567da83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.520882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248fe4-257c-44ba-8473-cd63aba2b3b1 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.526256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-15121396-a1d3-4c65-af65-f3856567da83 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:59.526751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.527588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.527761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-15121396-a1d3-4c65-af65-f3856567da83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:59.528156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.528588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.529656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.530214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.532339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.537874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 231/463] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:35:59.539025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121396-a1d3-4c65-af65-f3856567da83 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.544235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 233/464] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.554030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.558183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121396-a1d3-4c65-af65-f3856567da83 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.563463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.564602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.565109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.565691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.566887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.567414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.570028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.573406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe49d8-cae9-41ac-8cfe-ea35e08797f3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.583177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.584994 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.585622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.586199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.592322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 232/465] 10.222.0.48 () {56 vars in 1158 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.592995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.600602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.602948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.611903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f33bd-3849-4d4d-841f-6dfc7ef7c819 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.617305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.618521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.618953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.619420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.623800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:59.625450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 234/466] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.626702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.636586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:59.638710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b417e-5953-4ec5-a425-4bafce7c38c4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.643656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:59.644069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.645138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 233/467] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.645409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.645952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.646240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.647543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.656522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4854f-6470-457c-b6a5-84f02c1b1d42 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.660212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.661722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.663085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.663389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.663568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.663938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.664853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.665252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.666945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.679463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 234/468] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.680423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.685927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:59.687443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 235/469] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.693687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.696100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380cd3c-5574-4235-bf75-c18d26e08372 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.701009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.701951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.702186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.702574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.703443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.703832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.705547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.706514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa584a1-2730-4951-b883-63c5a1e7d66f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.712003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.712999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.713443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.713926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.715252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 235/470] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.716142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.722815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.725157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.725840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5929b-93d3-4741-b611-43923c947ca8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.730806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5d50f-f188-4fa7-aae6-ab1620f5fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.731657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d50f-f188-4fa7-aae6-ab1620f5fbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.732042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d50f-f188-4fa7-aae6-ab1620f5fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.732468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5d50f-f188-4fa7-aae6-ab1620f5fbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.733416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d50f-f188-4fa7-aae6-ab1620f5fbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.733841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d50f-f188-4fa7-aae6-ab1620f5fbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.735571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5d50f-f188-4fa7-aae6-ab1620f5fbe0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.743584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:35:59.744820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 236/471] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/users/cinder => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.745568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.752338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 236/472] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.753910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3118ab-5434-4af3-a925-df441dd936d1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.754245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3118ab-5434-4af3-a925-df441dd936d1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.754575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3118ab-5434-4af3-a925-df441dd936d1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.756880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 237/473] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:35:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:35:59.757299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bcba2-bf76-4fa9-863c-780bbd9ebeb0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.762185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3118ab-5434-4af3-a925-df441dd936d1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.765676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.766628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.766919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.767197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.775136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3118ab-5434-4af3-a925-df441dd936d1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.778526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.779727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398bb99-0440-48f9-9a54-59d4d0d6857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.780424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.780563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398bb99-0440-48f9-9a54-59d4d0d6857c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.780940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398bb99-0440-48f9-9a54-59d4d0d6857c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.781288 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398bb99-0440-48f9-9a54-59d4d0d6857c admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.782345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398bb99-0440-48f9-9a54-59d4d0d6857c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.782643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398bb99-0440-48f9-9a54-59d4d0d6857c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.784534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398bb99-0440-48f9-9a54-59d4d0d6857c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.800640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:59.801868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 237/474] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.807103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.807181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 238/475] 10.222.0.48 () {56 vars in 1158 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.807181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af289-e5a9-4073-8ec7-4c80ee0fcab3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.807330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af289-e5a9-4073-8ec7-4c80ee0fcab3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.807541 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af289-e5a9-4073-8ec7-4c80ee0fcab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.816125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f6903-488d-4701-8436-83323f4be95e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.821837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.822784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.823237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.823650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.825901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0a3af289-e5a9-4073-8ec7-4c80ee0fcab3 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:35:59.827095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0a3af289-e5a9-4073-8ec7-4c80ee0fcab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:35:59.831156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.833263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.835294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 239/476] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:35:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:35:59.836101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af289-e5a9-4073-8ec7-4c80ee0fcab3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.845223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af289-e5a9-4073-8ec7-4c80ee0fcab3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.850016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.850835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.851299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.852060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.852933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.853474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.853819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:35:59.855012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 238/477] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.855624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.855772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.867951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484d2e6-a26a-4db1-b10b-891adcf254b4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.873574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 240/478] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.873574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.873787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.873787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.873942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.874416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.881775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ca987-9407-4f81-8394-3325ed451cf9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.886331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.886467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.887162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.887563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.887941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.888300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.888960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.889424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.891321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.904159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 241/479] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.906152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:35:59.907348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 239/480] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.908109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.914969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.918031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f231d3-b73e-4805-a0e6-a78afa6299d5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.926073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.926073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.926073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.926073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.926448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5293e8-0edb-41bf-b10a-0c5d61129bc9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.930601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.931522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.931911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.932294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.935527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.937585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.944474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:35:59.952164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:35:59.952419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:35:59.953951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 240/482] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.954050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 242/482] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:35:59.954375 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.958400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.965531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1b3bc-b088-4ba0-baae-9d158f9d60ad admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.970503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b70d-89ac-432c-b190-1969ebe4475d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:35:59.970906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.971557 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.971841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.972114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.972848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:35:59.973148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.974947 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:35:59.975244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:35:59.976116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:35:59.976511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:35:59.976686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/6c767d4a9ad7459880884eb8c546dc55/roles/b0384dab922047ac99e3d88dcd0535a3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:35:59.989765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 241/483] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:35:59.991179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:35:59.991954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=6c767d4a9ad7459880884eb8c546dc55, role_id=b0384dab922047ac99e3d88dcd0535a3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:35:59.994765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.006545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65851d2a-1d2a-4b3c-b453-c55aade78c23 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.022093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 243/484] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:35:59 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/6c767d4a9ad7459880884eb8c546dc55/roles/b0384dab922047ac99e3d88dcd0535a3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:00.022093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.080249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.081694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.082198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.082595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.083689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.084508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.086949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.098185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1e2df-3ed8-46ae-b5cd-143becee8a0f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.101717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 242/485] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:35:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.102750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.108686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.109826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.110186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.111194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.112523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.112943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.114520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec0f56-469b-4c44-be07-beb9e3912b19 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.115941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.120288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.121218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.121607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.121951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.129909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.133061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.143492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 244/486] 10.222.0.48 () {56 vars in 1160 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.149908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.150268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:00.151667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 243/487] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:00.152537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.161149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eadfd4-eaeb-4e90-accd-3edebe2667f9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.167480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.168390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.168581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4c91b-2786-48e9-a1a4-bf315456666c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.168859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.169251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.173440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.174331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.174939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.175278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.184517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.187018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.188388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.190371 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.209749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:00.209947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:00.211314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 244/488] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:00.216841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 245/489] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:00.217798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.217981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.230543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302aa0-8739-4b61-a308-e7f60ac03ee4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.230740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523caae6-3a2f-4386-aafd-d77481dc08d3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.234490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.235460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.235765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.235880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.236233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.236612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.236966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.237268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.237394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.237668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.238863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.239246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.239816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.241771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.257347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 245/490] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.259415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.266709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 246/491] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.267545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.270240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0ac09-525b-45c6-abaf-6e2460072284 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.275155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.276002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.276452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.276871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.277813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.278263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.280008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.283430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fbef-b612-48ae-9e34-9f1c21797e77 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.288297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.289192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.289761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.290048 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/9e128ed2736b4158ae2009df5ba23fe6/roles/b0384dab922047ac99e3d88dcd0535a3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.294351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 246/492] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.295348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.307096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868dbeb-1c30-4093-816c-03867f918e31 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.307314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=9e128ed2736b4158ae2009df5ba23fe6, role_id=b0384dab922047ac99e3d88dcd0535a3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.310368 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.312383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.313425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.313857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.314687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.324519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.327084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.329548 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 247/493] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:00 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/9e128ed2736b4158ae2009df5ba23fe6/roles/b0384dab922047ac99e3d88dcd0535a3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:00.331006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.361507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:00.368773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 247/494] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:00.375245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.392143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da1412-ee51-4f5f-9262-a28f1c745507 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.463875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbceb8bc-4874-4d3a-8470-3488b0752dd2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.469150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.470280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.470833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.471258 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.472399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.472864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.475690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.476564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.477594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.478143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.478356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.492130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 248/495] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.494336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.496714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.498725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.516019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310bafd-bfd1-4b6e-b299-ce4c8015b8bb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.526918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:36:00.530459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.531637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.532115 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.532531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/671f4f6ff7d84739aecf74e53bb1aba5/roles/b0384dab922047ac99e3d88dcd0535a3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.534700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 248/496] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:00.542069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.557553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf26c5-9961-41b8-aebe-a4ea80d44bfb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.564597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.567231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=671f4f6ff7d84739aecf74e53bb1aba5, role_id=b0384dab922047ac99e3d88dcd0535a3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.567908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.568378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.568794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.569917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.570029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.570618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.572882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.590214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 249/497] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:00 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/671f4f6ff7d84739aecf74e53bb1aba5/roles/b0384dab922047ac99e3d88dcd0535a3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:36:00.598244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 249/498] 10.222.0.48 () {56 vars in 1156 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.605489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.672699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f0f4-256e-4925-aa75-207dd2809465 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.678899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.679922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.680469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.680928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.690528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.692684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.705317 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 250/499] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:36:00.714575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.731278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320127-9875-4578-aa19-2ab8ddb817c9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.739955 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.741629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.742072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.742450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.758775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.760832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.784243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:00.786081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 250/500] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:00.793180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.812037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000f874-003e-4d1f-b0b9-7e2e41290a0c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.821389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.822350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.822783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.823202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.824097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.824566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.826654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.842896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 251/501] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.849070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.863017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb658b2-5a57-49e0-b0c6-9702a758d273 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.867889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.868799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.869185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.869588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.878659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.880761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.894625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:00.896307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 251/502] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:00.903410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.914554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ec602-5c40-4747-9c03-01cdc43a72bb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.920838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36248857-3a55-436f-aaa9-c098eb0eb897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.921749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248857-3a55-436f-aaa9-c098eb0eb897 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.922040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248857-3a55-436f-aaa9-c098eb0eb897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.922320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36248857-3a55-436f-aaa9-c098eb0eb897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.923122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248857-3a55-436f-aaa9-c098eb0eb897 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.923432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248857-3a55-436f-aaa9-c098eb0eb897 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.925423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36248857-3a55-436f-aaa9-c098eb0eb897 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.939432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 252/503] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:00.948293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:00.961008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9533-d5dc-4484-bb44-1775f884d774 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:00.967037 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a9b29-a902-496a-8ef3-b3fc18db76f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:00.968028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a9b29-a902-496a-8ef3-b3fc18db76f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:00.968480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a9b29-a902-496a-8ef3-b3fc18db76f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:00.971395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a9b29-a902-496a-8ef3-b3fc18db76f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:00.971395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a9b29-a902-496a-8ef3-b3fc18db76f5 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=5c6cef3217904adcadea1a58a7b146e1) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:00.971395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a9b29-a902-496a-8ef3-b3fc18db76f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:00.972575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a9b29-a902-496a-8ef3-b3fc18db76f5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:00.982358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 252/504] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:00 2021] GET /identity/v3/role_assignments?user.id=5c6cef3217904adcadea1a58a7b146e1&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:01.813711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582855fc-cee9-47ff-9b98-590f9b1523c9 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:01.814235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582855fc-cee9-47ff-9b98-590f9b1523c9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:01.814310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582855fc-cee9-47ff-9b98-590f9b1523c9 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:01.816052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 253/505] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:01.822861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd3064-a203-43cd-a573-22d87ce98821 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:01.823304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd3064-a203-43cd-a573-22d87ce98821 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:01.823416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd3064-a203-43cd-a573-22d87ce98821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:01.848607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1bcd3064-a203-43cd-a573-22d87ce98821 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:01.849887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1bcd3064-a203-43cd-a573-22d87ce98821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:01.861008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 253/506] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:01.907296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582855fc-cee9-47ff-9b98-590f9b1523c9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:01.922965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582855fc-cee9-47ff-9b98-590f9b1523c9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:01.927554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:01.928978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:01.929265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:01.929578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:01.942229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:01.950136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:01.951928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 254/507] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:01.958242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd3064-a203-43cd-a573-22d87ce98821 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:01.969032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd3064-a203-43cd-a573-22d87ce98821 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:01.973741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:01.975429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:01.975624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:01.975994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:01.976866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:01.977271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:01.978978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:01.988329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 254/508] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:01.995204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.006193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8804a0c-213b-4322-b545-da82c84910c7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.018946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.020062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.020440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.020810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.040765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.043316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.066581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:02.068098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 255/509] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:02.074275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.091158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3903078-84b8-4522-a177-5e7ade92bffd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.097173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.097984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.098361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.098730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.100109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:02.100500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.102482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.124494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 255/510] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:02.130893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.146554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882a100-2563-4c79-8a5c-eb7988898479 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.157641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.158439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.158734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.158993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.175692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.177829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.198342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:36:02.204049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 256/511] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:02.211195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.227059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503eba-0149-4f8d-8262-808c85612157 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.237124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.237960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.238344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.238719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.239675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:02.240101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.242795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.269578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 256/512] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:02.271798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.286706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d99e36-618d-4b6d-8311-74033d0d31bb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.296520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.297465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.297894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.298395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.313459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.315490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.329640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 257/513] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:02.336413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.353505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b2089-3d78-47d0-9fd1-6bad2c692bb8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.368298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.369421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.369790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.370162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.389575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.391461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.420600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:02.422197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 257/514] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:02.428043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.441028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00b952-27de-451c-a286-6338cc916cf5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.449815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.450987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.451421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.451848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.452820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:02.453273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.455126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.487433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 258/515] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:02.493198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.506678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf61fc0-d3fc-422c-b44d-0637ab7719f3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.523242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.524072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.524359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.524641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.538835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.540806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.560943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:02.562479 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 258/516] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:02.569347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.592445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750bd80-be63-4d6d-ba67-1b758bb4c9dc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.608682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2a284-bbe1-406c-b93b-e75dd5ea4f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.609752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a284-bbe1-406c-b93b-e75dd5ea4f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.610224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a284-bbe1-406c-b93b-e75dd5ea4f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.610683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a284-bbe1-406c-b93b-e75dd5ea4f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.612054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2a284-bbe1-406c-b93b-e75dd5ea4f39 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:02.612573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2a284-bbe1-406c-b93b-e75dd5ea4f39 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.615879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2a284-bbe1-406c-b93b-e75dd5ea4f39 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.645744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 259/517] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:02.652816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.675208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f3178-c89b-47f6-b752-11004e262e76 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:02.691778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9fa0a-328f-413c-973f-769d0d0ddce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:02.692450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9fa0a-328f-413c-973f-769d0d0ddce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.692737 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9fa0a-328f-413c-973f-769d0d0ddce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.693015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9fa0a-328f-413c-973f-769d0d0ddce3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.694422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9fa0a-328f-413c-973f-769d0d0ddce3 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=da3ce1b443aa425c99aab2ca8e6b53c8) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:02.694736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9fa0a-328f-413c-973f-769d0d0ddce3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:02.696739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9fa0a-328f-413c-973f-769d0d0ddce3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:02.711321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 259/518] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/role_assignments?user.id=da3ce1b443aa425c99aab2ca8e6b53c8&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:02.895193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86fcd-c70e-421b-b4c0-02b7aae80fc9 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.895717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86fcd-c70e-421b-b4c0-02b7aae80fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.895916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86fcd-c70e-421b-b4c0-02b7aae80fc9 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.898463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 260/519] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:02.904767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb10850-9d05-408d-9c98-e1c90efdb33f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:02.905392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb10850-9d05-408d-9c98-e1c90efdb33f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:02.905392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb10850-9d05-408d-9c98-e1c90efdb33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:02.939205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1eb10850-9d05-408d-9c98-e1c90efdb33f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:02.940588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1eb10850-9d05-408d-9c98-e1c90efdb33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:02.952090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 260/520] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:02.977762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86fcd-c70e-421b-b4c0-02b7aae80fc9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:02.995571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86fcd-c70e-421b-b4c0-02b7aae80fc9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.002547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.003358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.003640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.003914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.018228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:03.033610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:03.035066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 261/521] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:02 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:03.041732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb10850-9d05-408d-9c98-e1c90efdb33f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.050975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb10850-9d05-408d-9c98-e1c90efdb33f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.057829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.058507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.058786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.059061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.059851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.060134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.061753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.071532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 261/522] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:03.078145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.089143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854aa1-3877-4380-98ae-c7365df5dfa2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.093675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.094447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.094730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.095005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.105966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.107834 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.126980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:03.128685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 262/523] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.135988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.145822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e90ff6-ef31-4cb2-8b00-ade293dd6991 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.150638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.151298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.151582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.151854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.152582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.152884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.154490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.166962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 262/524] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:03.172948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.183397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529d313-024e-4a4e-8406-787b90e16ee4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.188401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.189186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.189543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.189886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.198742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.201012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.215174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 16:36:03.216633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 263/525] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/users/glance => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.222866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.232828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74444601-905a-4ac4-afbc-f33ef48f8a28 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.237289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.237979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.238263 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.238539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.239383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.239689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.242077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.261308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 263/526] 10.222.0.48 () {56 vars in 1158 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:03.267329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.278149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda39ff-4a28-4092-9901-62654e307fc2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.283177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.283817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.284101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.284372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.293166 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.294975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.306052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 264/527] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:03.312283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.323485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd326d-1678-4897-967f-5dc6958cc813 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.328734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.329579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.329866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.330139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.343275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.345462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.366840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:03.368611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 264/528] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.375024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.385101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086c2e4-34e3-4413-86c4-edfb9cc08d66 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.389913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfef7f-2019-48ea-aadf-d06bba505a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.390780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfef7f-2019-48ea-aadf-d06bba505a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.391062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfef7f-2019-48ea-aadf-d06bba505a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.391335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfef7f-2019-48ea-aadf-d06bba505a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.392068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfef7f-2019-48ea-aadf-d06bba505a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.392369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfef7f-2019-48ea-aadf-d06bba505a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.393996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfef7f-2019-48ea-aadf-d06bba505a91 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.406814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 265/529] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:03.412827 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.423574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb4ce-4625-482b-b0a6-53f3a5342f9a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.430477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.431316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.431603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.431924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.439343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.441420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.455967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:03.460877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 265/530] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.462362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003297d5-3dae-4873-91e0-f3724b4944ce None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.462752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003297d5-3dae-4873-91e0-f3724b4944ce None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.462922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003297d5-3dae-4873-91e0-f3724b4944ce None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.464924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 266/531] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:03.468121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.478724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834ab00-6a88-4cbd-9432-ed47f2c24473 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.479211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834ab00-6a88-4cbd-9432-ed47f2c24473 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.479657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834ab00-6a88-4cbd-9432-ed47f2c24473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.482750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890f84c-4157-44e9-aaf0-b98b11ca071e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.486960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3111-fa6b-4e19-9e72-36fa856a1e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.487608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3111-fa6b-4e19-9e72-36fa856a1e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.487899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3111-fa6b-4e19-9e72-36fa856a1e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.488176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3111-fa6b-4e19-9e72-36fa856a1e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.489064 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3111-fa6b-4e19-9e72-36fa856a1e3d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.489397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3111-fa6b-4e19-9e72-36fa856a1e3d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.491837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3111-fa6b-4e19-9e72-36fa856a1e3d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.504219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 266/532] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:03.504570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7834ab00-6a88-4cbd-9432-ed47f2c24473 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:03.509393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7834ab00-6a88-4cbd-9432-ed47f2c24473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:03.514061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbcc5-7cfb-4f4e-bc10-0618adb8dd37 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.514572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbcc5-7cfb-4f4e-bc10-0618adb8dd37 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.515038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebbcc5-7cfb-4f4e-bc10-0618adb8dd37 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.516996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 267/533] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:03.521688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 267/534] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:03.522960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47b671-e119-4d33-a2fe-f51a5ec927ee None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.523325 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47b671-e119-4d33-a2fe-f51a5ec927ee None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.523480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834ab00-6a88-4cbd-9432-ed47f2c24473 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.523745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47b671-e119-4d33-a2fe-f51a5ec927ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.534112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834ab00-6a88-4cbd-9432-ed47f2c24473 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.540039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.540690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.540973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.541249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.542130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=6c767d4a9ad7459880884eb8c546dc55) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.542441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.542592 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4f47b671-e119-4d33-a2fe-f51a5ec927ee None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:03.543847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4f47b671-e119-4d33-a2fe-f51a5ec927ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:03.544269 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.550986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 268/535] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/role_assignments?user.id=6c767d4a9ad7459880884eb8c546dc55&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:03.552275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 268/536] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:03.570412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.576483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbb2bc-7ac5-4571-a546-d531e5f4e5bd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.577539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47b671-e119-4d33-a2fe-f51a5ec927ee None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.581784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.582838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.583272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.583725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.588912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47b671-e119-4d33-a2fe-f51a5ec927ee None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.594860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.595691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.596035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.596348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.599582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:03.610142 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:03.610342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:03.612185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 269/537] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.621534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:03.621534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 269/538] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:03.622894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.626572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.637429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf304-4127-4b9c-bf82-b5acd0868888 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.637665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053a796-35ca-4682-b4d4-c45118b8f660 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.647484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.648620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.649042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.649337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.649654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.650573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.650852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.651898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.652209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.652758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.653658 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.653971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.656241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.657838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.677767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 270/539] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:03.678517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 270/540] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:03.682347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.692112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.704425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc65648-f52a-412f-b908-4e509c81411b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.707623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ca846-4452-4965-913b-85aa0488bacf admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.715664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.716605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.717773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.718093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.718424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.718701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.719520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.719855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.743326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.745322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.746464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.747185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.775304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:03.779779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:03.781030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 271/541] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.786558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 271/542] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.788066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.790444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.802576 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c7975-1eae-4d87-b67d-0aa70b157feb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.805194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8eff-bf17-47d8-896d-499c2dd8f662 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.809955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.810624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.810966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.811076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.811245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.811622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.811914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.812042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.812194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.812359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.812936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.813247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.814089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.814876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.826979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 272/543] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:03.831824 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 272/544] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:03.833177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.834651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.844592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83ed2d-81eb-4180-8fd3-16b0cbe9847d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.845077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e54a1-16a5-45fe-baa3-bd3736685b54 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.849192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.850640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.850898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.851197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.851476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.851581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.851771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.852159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.859909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.862081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.862197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.864370 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.876257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:36:03.877871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 273/545] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:03.879119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 16:36:03.884146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.884545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 273/546] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/users/neutron => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:03.889892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.895493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d236fd2-88f7-4b2e-9316-8402ea32b262 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.900803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.901090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570297ce-33c3-4861-ad6b-401058c573fd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.901675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.902030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.902380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.903322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.903703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.906508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.906923 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.908227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.908689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.909179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.910284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:03.910808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.913484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.931399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 274/547] 10.222.0.48 () {56 vars in 1158 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:03.936303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 274/548] 10.222.0.48 () {56 vars in 1160 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:03.937522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.939761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.947743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dd922-1af8-493f-8e0c-bd275b83e2e4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.952082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c16579-493a-4065-b01f-31146ea7050d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.953051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.953816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.954203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.954525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.957975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:03.958826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:03.959886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:03.960390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:03.963792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.965577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.969915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:03.972025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:03.975917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 275/549] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:03.981972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.983887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 275/550] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:36:03.990331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:03.990996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319110-7509-45d6-ad23-e464f3ccc989 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:03.996792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.002416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.002702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.002985 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.003702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b5d5f-bc5a-4c66-9d1b-d39386b4b9b9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.008820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.009927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.010429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.010959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.013961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.015808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.025959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.028214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.034597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:04.035855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 276/551] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:04.042495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.047982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:04.049531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 276/552] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:04.052996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290093-7bf5-418b-9c09-a8d18f210421 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.056928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.057951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.058616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.058904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.059180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.059921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.060229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.061869 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.069590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196a83c-59af-42ec-b9ef-8c3d7866ddcb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.074615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.074977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 277/553] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.076229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.076728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.077212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.078260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.078811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.080888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.081132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.092054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d66587-471b-414b-af3e-19f8e70befbf admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.101414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.101414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.101414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.101414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.101840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 277/554] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:04.104557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.112403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.114761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.120828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab8837-c5d9-47a0-bec2-8c5a854b3b7a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.126326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.127360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.127755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.128145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.132495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:04.134011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 278/555] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:04.138724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.141715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.142237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.154062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159544be-3904-492f-82f0-4a790076dc50 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.159029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:04.159150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.160012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.160460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.165421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 278/556] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:04.165563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.165563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.165563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.165563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.168168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.179617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed820d67-811a-49bd-8223-56513277ae6c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.185229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.186065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.186471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.186627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 279/557] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.187716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.193414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.193414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.195279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.195991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.209005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8971b-4f96-468f-9474-988095cbfb1a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.213705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 279/558] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.217436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.221474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb9c0a-75c3-4e50-84f8-efef1aaa3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.222333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9c0a-75c3-4e50-84f8-efef1aaa3035 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.222824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9c0a-75c3-4e50-84f8-efef1aaa3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.223249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9c0a-75c3-4e50-84f8-efef1aaa3035 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.225326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9c0a-75c3-4e50-84f8-efef1aaa3035 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=9e128ed2736b4158ae2009df5ba23fe6) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.225853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9c0a-75c3-4e50-84f8-efef1aaa3035 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.228205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9c0a-75c3-4e50-84f8-efef1aaa3035 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.229006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c7337-c6b9-4521-b5f5-6e8dede67e0d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.234348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390bb6e-f34b-4020-a4cd-e7787f750d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.235198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390bb6e-f34b-4020-a4cd-e7787f750d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.235587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390bb6e-f34b-4020-a4cd-e7787f750d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.236027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390bb6e-f34b-4020-a4cd-e7787f750d01 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.241294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390bb6e-f34b-4020-a4cd-e7787f750d01 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=671f4f6ff7d84739aecf74e53bb1aba5) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.241294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390bb6e-f34b-4020-a4cd-e7787f750d01 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.241294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390bb6e-f34b-4020-a4cd-e7787f750d01 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.241939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 280/559] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/role_assignments?user.id=9e128ed2736b4158ae2009df5ba23fe6&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.246942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 280/560] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/role_assignments?user.id=671f4f6ff7d84739aecf74e53bb1aba5&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.279819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6365f21-e9d1-41c7-9dd2-8344afa16703 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.280106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6365f21-e9d1-41c7-9dd2-8344afa16703 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.280380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6365f21-e9d1-41c7-9dd2-8344afa16703 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.282275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 281/561] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:04.291964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd024f0-954b-4e9e-bb45-73f4fabe96b4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.292265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd024f0-954b-4e9e-bb45-73f4fabe96b4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.292554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd024f0-954b-4e9e-bb45-73f4fabe96b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.319768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1dd024f0-954b-4e9e-bb45-73f4fabe96b4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:04.321065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1dd024f0-954b-4e9e-bb45-73f4fabe96b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:04.339031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 281/562] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:04.363701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6365f21-e9d1-41c7-9dd2-8344afa16703 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.382566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6365f21-e9d1-41c7-9dd2-8344afa16703 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.389787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.390619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.391008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.391343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.410094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:04.417510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:04.418791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 282/563] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:04.425686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd024f0-954b-4e9e-bb45-73f4fabe96b4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.437130 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd024f0-954b-4e9e-bb45-73f4fabe96b4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.444173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.444875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.445165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.445559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.446430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.446747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.448613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.462987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 282/564] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.469448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.482442 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36740c-c40a-450a-a21a-0193408c39d2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.488284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.489153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.489472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.489761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.505918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.508466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.533200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:04.534694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 283/565] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:04.541059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.551844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef365b-6045-4599-b3a2-a6d4536ee31e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.558096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.558830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.559118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.559453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.560195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.560505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.562224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.578888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 283/566] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.585046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.597500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1e513-18b3-4439-8b86-c3a964ce0321 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.602078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.602873 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.603154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.603438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.611934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.614002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.629960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:36:04.631711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 284/567] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:04.638064 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.651338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74f3f3-1384-4646-9214-e1ab288cd7f2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.655939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.656617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.656887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.657173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.659546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.659865 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.661878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.680772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 284/568] 10.222.0.48 () {56 vars in 1156 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.687362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.703717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c7882-2b83-4993-9b28-4a144acdbc8c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.713786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.714844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.715277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.715701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.732093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.734233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.759671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:04.761531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 285/569] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:04.767359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.781550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284c48-0a31-4d3f-9b6f-0af9011bce6a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.789161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.789913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.790199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.790481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.791281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.791594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.793184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.820191 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 285/570] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.826701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.838705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34efeaae-ec14-4a2d-83e9-585cef6bc2a4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.849624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.850678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.851116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.851547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.864633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.867410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.891263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:04.893089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 286/571] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:04.899162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.914995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abfb6c-2a4c-4b34-9a97-a5b72a1a778e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.925220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ccf3b-42a5-400d-8530-8146c54b0af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.925925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ccf3b-42a5-400d-8530-8146c54b0af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.926215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ccf3b-42a5-400d-8530-8146c54b0af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.926496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ccf3b-42a5-400d-8530-8146c54b0af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.927312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ccf3b-42a5-400d-8530-8146c54b0af1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:04.927685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ccf3b-42a5-400d-8530-8146c54b0af1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.930249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ccf3b-42a5-400d-8530-8146c54b0af1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:04.952067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 286/572] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:04.958812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:04.971507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399815fd-dafc-452c-a013-e081545cd1f3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:04.976586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab9790-a209-4056-a177-7bf58ae3f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:04.977535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab9790-a209-4056-a177-7bf58ae3f10e admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:04.977821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab9790-a209-4056-a177-7bf58ae3f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:04.978157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab9790-a209-4056-a177-7bf58ae3f10e admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/5c6cef3217904adcadea1a58a7b146e1/roles/b0384dab922047ac99e3d88dcd0535a3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:04.993783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab9790-a209-4056-a177-7bf58ae3f10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=5c6cef3217904adcadea1a58a7b146e1, role_id=b0384dab922047ac99e3d88dcd0535a3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:04.996505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab9790-a209-4056-a177-7bf58ae3f10e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:05.012529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 287/573] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:04 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/5c6cef3217904adcadea1a58a7b146e1/roles/b0384dab922047ac99e3d88dcd0535a3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:06.247887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ba301-e647-40a5-a6c8-9ba04d33a4f0 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.248932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ba301-e647-40a5-a6c8-9ba04d33a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.249484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ba301-e647-40a5-a6c8-9ba04d33a4f0 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.251715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 287/574] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:06.270002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273e7e-fc4d-4192-ac74-6ae0fe4d557a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.270491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273e7e-fc4d-4192-ac74-6ae0fe4d557a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.270491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273e7e-fc4d-4192-ac74-6ae0fe4d557a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.298425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-59273e7e-fc4d-4192-ac74-6ae0fe4d557a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:06.299663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-59273e7e-fc4d-4192-ac74-6ae0fe4d557a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:06.375400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 288/575] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:06.423927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ba301-e647-40a5-a6c8-9ba04d33a4f0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.439779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ba301-e647-40a5-a6c8-9ba04d33a4f0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.449134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.450257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.450777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.451519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.468293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:06.476238 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:06.478131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 288/576] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:06.484970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273e7e-fc4d-4192-ac74-6ae0fe4d557a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.499135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273e7e-fc4d-4192-ac74-6ae0fe4d557a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.514309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.515018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.515308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.515588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.516384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:06.516694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.518366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.527943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 289/577] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:06.533966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.550685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f4956-06d4-4f3c-b5cc-3a5523fa8e47 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.559793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf99006-3c96-4bc9-87a9-edcb6619a824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.560895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf99006-3c96-4bc9-87a9-edcb6619a824 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.561502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf99006-3c96-4bc9-87a9-edcb6619a824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.561986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf99006-3c96-4bc9-87a9-edcb6619a824 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.577544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf99006-3c96-4bc9-87a9-edcb6619a824 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.579746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf99006-3c96-4bc9-87a9-edcb6619a824 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.601396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-ebf99006-3c96-4bc9-87a9-edcb6619a824 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:06.602956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 289/578] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:06.609486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.624001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef1677-90c7-4f52-bc2b-3aadee2aa258 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.639381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.640085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.640374 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.640655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.641474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:06.641790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.643446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.668002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 290/579] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:06.672065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522cf2-4c05-4876-86b8-4da3d3418a1e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.672610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522cf2-4c05-4876-86b8-4da3d3418a1e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.673092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522cf2-4c05-4876-86b8-4da3d3418a1e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.675411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 290/580] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:06.679839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.690100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9625-53e9-4ff5-ba3c-b23053ea441f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.690386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9625-53e9-4ff5-ba3c-b23053ea441f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.690673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a9625-53e9-4ff5-ba3c-b23053ea441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.690795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771bb21-8fb2-418e-b710-f2fb76c473e1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.695847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.696633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.696919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.697212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.705318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.707373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.721985 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:36:06.723511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 291/581] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:06.726465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3d4a9625-53e9-4ff5-ba3c-b23053ea441f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:06.727708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3d4a9625-53e9-4ff5-ba3c-b23053ea441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:06.730122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.742665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45614406-9eaf-46fb-8b4d-6d98e5dba4a5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.747644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 291/582] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:06.754142 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.754880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.755173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.755453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.757038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:06.757426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.759400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.785256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 292/583] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:06.791695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a9625-53e9-4ff5-ba3c-b23053ea441f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.799443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.809948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fa1f2-1664-4db2-a57a-0d8fbe25a49d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.811844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a9625-53e9-4ff5-ba3c-b23053ea441f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.815053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.815900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.816187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.816512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.829487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.830087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.830761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.831048 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.831331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.831499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.849616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:06.850510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.851196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 293/584] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:06.852289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.857545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.868024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1122580-0ff7-4a05-9978-a0a03c59e79d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.872730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 292/585] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:06.872936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.873496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.873840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.874128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.875118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:06.875433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.877112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.880274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.890757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 294/586] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:06.896824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.899922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7ec9-231c-442f-ac3a-e63a17e0de5a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.907768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efad3de-eb33-40dc-bb9c-b929a95ce0d8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.913043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.913841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.914145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.914535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.915045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.915382 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.915837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.916121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:06.916401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:06.917487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.939086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:06.941207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:06.954995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 295/587] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:36:06 2021] POST /identity/v3/users => generated 254 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:06.969781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:06.971382 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 293/588] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:06.977986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:06.990169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d2aa1-b148-4bea-a2e1-bba0f4756832 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:06.998534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20a819-ab16-4d2a-92c2-0315ecdc8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:06.999366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a819-ab16-4d2a-92c2-0315ecdc8d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:06.999740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a819-ab16-4d2a-92c2-0315ecdc8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.000097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20a819-ab16-4d2a-92c2-0315ecdc8d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.000936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20a819-ab16-4d2a-92c2-0315ecdc8d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:07.001321 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20a819-ab16-4d2a-92c2-0315ecdc8d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.003170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20a819-ab16-4d2a-92c2-0315ecdc8d21 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.018470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 296/589] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:07.026565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.038563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9079c-088b-43e3-97f2-17efb8ab4f4b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.045791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2c7bb-5913-4585-a716-8f762cc2f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.046647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c7bb-5913-4585-a716-8f762cc2f93c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.046937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c7bb-5913-4585-a716-8f762cc2f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.047221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2c7bb-5913-4585-a716-8f762cc2f93c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.057593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2c7bb-5913-4585-a716-8f762cc2f93c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.059678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2c7bb-5913-4585-a716-8f762cc2f93c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.077253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-0cb2c7bb-5913-4585-a716-8f762cc2f93c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:07.080424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc2ab2-6632-45e0-abef-97d9ce93ac2a None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.080725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc2ab2-6632-45e0-abef-97d9ce93ac2a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.081007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc2ab2-6632-45e0-abef-97d9ce93ac2a None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.082939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 297/591] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:07.083146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 294/590] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:07.085084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc2ab2-6632-45e0-abef-97d9ce93ac2a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.089825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d6526-363e-4480-b8cc-35383c62007d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.090950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d6526-363e-4480-b8cc-35383c62007d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.090950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d6526-363e-4480-b8cc-35383c62007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.102456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc2ab2-6632-45e0-abef-97d9ce93ac2a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.113293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.114845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.116875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.117462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.118561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:07.119295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.123141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.126391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f42d6526-363e-4480-b8cc-35383c62007d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:07.129477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f42d6526-363e-4480-b8cc-35383c62007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:07.145138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 295/592] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:07.151884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 298/593] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:07.158105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d6526-363e-4480-b8cc-35383c62007d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.168663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.179350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d6526-363e-4480-b8cc-35383c62007d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.184621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec79de-00fa-4e86-958e-bc36e4b6ca63 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.190103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.191212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.192640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.193521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.195171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=da3ce1b443aa425c99aab2ca8e6b53c8) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:07.195965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.197304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.198246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.200293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.200737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.201149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] PATH_INFO: `/v3/services/network` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.202257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.205405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:07.205405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:36:07.205405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:36:07.206585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.216332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 296/594] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/role_assignments?user.id=da3ce1b443aa425c99aab2ca8e6b53c8&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:07.225573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:36:07.227357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 299/595] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/services/network => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:07.234262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.250507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b86917-8beb-4b81-9e0c-82409d53d79d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.257949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.258841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.259271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.259655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.260549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] RBAC: Adding query filter params (name=network) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:07.260977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.262202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:07.262202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:36:07.262202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:36:07.263319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d92206-2573-4016-aa30-8d92bf5d1a62 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.274180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 297/596] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:07.280637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.292774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f174d2c-8e83-42d2-bc45-789daec251ee admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.306280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.307268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.307708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.308138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.309071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] RBAC: Adding query filter params (type=network) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:07.309581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.310803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:07.310803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:36:07.310803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:36:07.312038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389417f-8d6a-43e8-a509-2e1ee9f8f6fd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.319059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 300/597] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/services?type=network => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:07.582986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdcc30-0a19-4433-8a07-4bf4c5e96ef5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.583339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdcc30-0a19-4433-8a07-4bf4c5e96ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.583536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdcc30-0a19-4433-8a07-4bf4c5e96ef5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.586139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 298/598] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:07.592320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4f513-017b-42cb-8ab5-74d3211743d5 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.592617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4f513-017b-42cb-8ab5-74d3211743d5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.592900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4f513-017b-42cb-8ab5-74d3211743d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.616647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a4e4f513-017b-42cb-8ab5-74d3211743d5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:07.617923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a4e4f513-017b-42cb-8ab5-74d3211743d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:07.630905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 301/599] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:07.654841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdcc30-0a19-4433-8a07-4bf4c5e96ef5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.678368 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdcc30-0a19-4433-8a07-4bf4c5e96ef5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.683323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.684165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.684451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.684734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.685443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.686495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:07.686495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:36:07.686495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:36:07.687402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.703656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:36:07.705099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 299/600] 10.222.0.48 () {56 vars in 1150 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:07.712402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4f513-017b-42cb-8ab5-74d3211743d5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.727581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4f513-017b-42cb-8ab5-74d3211743d5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.734437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442c30b-178e-4fd6-89b2-a695c04bb4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.735169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442c30b-178e-4fd6-89b2-a695c04bb4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.735461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442c30b-178e-4fd6-89b2-a695c04bb4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.735742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442c30b-178e-4fd6-89b2-a695c04bb4b2 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.736488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442c30b-178e-4fd6-89b2-a695c04bb4b2 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:07.736797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442c30b-178e-4fd6-89b2-a695c04bb4b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.738457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442c30b-178e-4fd6-89b2-a695c04bb4b2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.743509 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 302/601] 10.222.0.48 () {56 vars in 1145 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:07.749842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.760211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211d3c8-1b97-42ad-bc54-f884a003fa0e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.768544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927820f-e336-4510-9692-690f9230910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.769276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927820f-e336-4510-9692-690f9230910b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.769602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927820f-e336-4510-9692-690f9230910b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.769929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927820f-e336-4510-9692-690f9230910b admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.770799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927820f-e336-4510-9692-690f9230910b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:07.771115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927820f-e336-4510-9692-690f9230910b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:07.773327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927820f-e336-4510-9692-690f9230910b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:07.782340 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 300/602] 10.222.0.48 () {56 vars in 1145 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:07.845920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297d06-d304-4786-8b18-253ef8dfa505 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.846252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297d06-d304-4786-8b18-253ef8dfa505 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.846426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297d06-d304-4786-8b18-253ef8dfa505 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.848302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 303/603] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:07.857306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b28a-79d8-46c2-9ad1-da87baa7bbc0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.857662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b28a-79d8-46c2-9ad1-da87baa7bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.857907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b28a-79d8-46c2-9ad1-da87baa7bbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.882665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-71f5b28a-79d8-46c2-9ad1-da87baa7bbc0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:07.883978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-71f5b28a-79d8-46c2-9ad1-da87baa7bbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:07.897788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 301/604] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:07.926376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297d06-d304-4786-8b18-253ef8dfa505 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.941941 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297d06-d304-4786-8b18-253ef8dfa505 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:07.950700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:07.951837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:07.952171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:07.952509 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:07.967594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:07.975635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:07.977532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 304/605] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:07.984570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5b28a-79d8-46c2-9ad1-da87baa7bbc0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:07.996920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5b28a-79d8-46c2-9ad1-da87baa7bbc0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.005396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.005396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.005396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.005396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.005742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:08.006056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.008304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.020701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 302/606] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:08.027429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.042868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d6c3d-7077-4605-b725-6df4be2163de admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.048847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.049797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.050141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.050424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.070494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.072627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.091338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:08.092788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 305/607] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:08.099044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.109952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975be4ff-5953-45eb-8a2a-f73cb5c463e6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.114775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.115460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.115886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.116177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.116939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:08.117309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.119067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.139820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 303/608] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:08.148757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.163156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59964786-fa52-41ec-a0b8-f2016babbfc1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.169176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.170135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.170430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.170823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.180452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.182694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.198336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:36:08.199985 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 306/609] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:08.206927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.219757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa453cd-5659-4961-80ae-f31c486a60c2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.224612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.226024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.226350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.226631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.227872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:08.228189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.230307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.251657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 304/610] 10.222.0.48 () {56 vars in 1156 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:08.258126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.268531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7393f-7ecd-4fac-92b6-74045c0c3c6a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.281212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.285593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.286150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.286707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.307946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.310456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.325023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 307/611] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:08.335237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.356059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf01d0-d15a-4ebe-81b6-408c6dc05eed admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.364158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.365963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.366577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.367183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.381765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.384484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.407736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:08.410205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 305/612] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:08.419040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.435313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34727b-430b-49d9-9984-d08682e67303 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.444888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.445875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.446356 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.446778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.447958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:08.448408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.450584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.475920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 308/613] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:08.482565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.502538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818785-8aef-49c8-a929-e7f6170f7403 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.513732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.514870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.515358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.515862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.531090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.533421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.556972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:08.558534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 306/614] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:08.565004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.579031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb4b2-9d94-4f95-9548-081d12ede047 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.588769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee00bf-8c95-42f9-b8b6-9b5286c117d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.589507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee00bf-8c95-42f9-b8b6-9b5286c117d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.589798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee00bf-8c95-42f9-b8b6-9b5286c117d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.590077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee00bf-8c95-42f9-b8b6-9b5286c117d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.590893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee00bf-8c95-42f9-b8b6-9b5286c117d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:08.591204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee00bf-8c95-42f9-b8b6-9b5286c117d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.593153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee00bf-8c95-42f9-b8b6-9b5286c117d7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.610666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 309/615] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:08.617454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:08.636581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b3a4-20df-4f1e-af70-e0be5ffe38c7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:08.650878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28f5dd-cb24-410f-9960-8850f7e707b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:08.652180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28f5dd-cb24-410f-9960-8850f7e707b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:08.652712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28f5dd-cb24-410f-9960-8850f7e707b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:08.653307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28f5dd-cb24-410f-9960-8850f7e707b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:08.654396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28f5dd-cb24-410f-9960-8850f7e707b0 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=5c6cef3217904adcadea1a58a7b146e1) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:08.654915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28f5dd-cb24-410f-9960-8850f7e707b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:08.656967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28f5dd-cb24-410f-9960-8850f7e707b0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:08.670208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 307/616] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:08 2021] GET /identity/v3/role_assignments?user.id=5c6cef3217904adcadea1a58a7b146e1&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:09.979818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09294eb3-1272-4d66-929d-ccd0e0826042 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:09.980350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09294eb3-1272-4d66-929d-ccd0e0826042 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:09.980350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09294eb3-1272-4d66-929d-ccd0e0826042 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:09.982660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 310/617] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:09.988820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794442c5-c6a2-4055-bafe-0f23af9ac21c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:09.989427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794442c5-c6a2-4055-bafe-0f23af9ac21c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:09.989427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794442c5-c6a2-4055-bafe-0f23af9ac21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.019076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-794442c5-c6a2-4055-bafe-0f23af9ac21c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:10.021071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-794442c5-c6a2-4055-bafe-0f23af9ac21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:10.038374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 308/618] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:10.074886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09294eb3-1272-4d66-929d-ccd0e0826042 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.091477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09294eb3-1272-4d66-929d-ccd0e0826042 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.099834 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.100707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.101062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.101345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.112184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6dc6-c756-4f8c-bdf4-79db3cebf0f1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.112532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6dc6-c756-4f8c-bdf4-79db3cebf0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.112817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6dc6-c756-4f8c-bdf4-79db3cebf0f1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.114978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 309/619] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:10.121174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf517-3412-495c-9c26-c5bc24899e76 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.121485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf517-3412-495c-9c26-c5bc24899e76 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.121752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:10.121869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdf517-3412-495c-9c26-c5bc24899e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.128915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:10.130604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 311/620] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:10.138602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.159193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668b8f-4a53-4af0-93b5-54476a6fbf74 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.160829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2dbdf517-3412-495c-9c26-c5bc24899e76 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:10.162149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2dbdf517-3412-495c-9c26-c5bc24899e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:10.169073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.169778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.170064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.170333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.171112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.171425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.173024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.186189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 312/621] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:10.187861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 310/622] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:10.192443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.210285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1abf-5a47-433c-97f1-4e318e6fd3ea None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.210614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1abf-5a47-433c-97f1-4e318e6fd3ea None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.210882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1abf-5a47-433c-97f1-4e318e6fd3ea None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.212730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26586-c487-423d-8757-c16610afe073 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.213169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 311/623] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:10.215108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1abf-5a47-433c-97f1-4e318e6fd3ea None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.224191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffddb0-9f5e-4785-80b8-86e3a075bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.225001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffddb0-9f5e-4785-80b8-86e3a075bad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.225855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffddb0-9f5e-4785-80b8-86e3a075bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.226128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffddb0-9f5e-4785-80b8-86e3a075bad1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.235765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba1abf-5a47-433c-97f1-4e318e6fd3ea None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.238255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffddb0-9f5e-4785-80b8-86e3a075bad1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.240664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.241421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ffddb0-9f5e-4785-80b8-86e3a075bad1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.242356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.242859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.243247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.244275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.245432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:10.245432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:36:10.245432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:36:10.246839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.263001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-f9ffddb0-9f5e-4785-80b8-86e3a075bad1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:10.264890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 313/624] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:10.266583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e331-f6f0-4668-8b1d-506f2eeca493 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.267020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e331-f6f0-4668-8b1d-506f2eeca493 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.267687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 312/625] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:10 2021] POST /identity/v3/services => generated 240 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:10.267833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779e331-f6f0-4668-8b1d-506f2eeca493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.277332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.289177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7779e331-f6f0-4668-8b1d-506f2eeca493 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:10.290674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7779e331-f6f0-4668-8b1d-506f2eeca493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:10.300508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbf60d-9b43-4cde-a69e-16193ff44d50 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.306487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.307328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.307725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.308109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.309019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.309470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.311208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.326728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 313/626] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:10.328820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 314/627] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:10 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:10.332939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.349920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820e1c6-12be-4d6a-a054-8699c805772b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.355352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779e331-f6f0-4668-8b1d-506f2eeca493 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.359565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.360458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.360828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.361224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.368163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779e331-f6f0-4668-8b1d-506f2eeca493 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.373764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.375023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.375572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.376252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.378685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.381122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.393797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:10.401958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:10.403958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 315/628] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:10.413470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:36:10.413932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 314/629] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:10.415933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.420960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.443698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e35cd-b739-4394-8ba3-3d4a3c5052bb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.447113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ebd40-05b8-4d1c-a917-ca6be0b0f026 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.452581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.453620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.454091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.454572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.455631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.456140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.458217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.466940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.467641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.467935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.468215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.469151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.469509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.470560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 316/630] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:10.477389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.486805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.513160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0473ba-4109-4b7c-9398-dbd1b98941c1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.518839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 315/631] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:10.529422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.529678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.529678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.530101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.530198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.545586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c7e9-c2d3-42d5-b8f3-92fd3f5890cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.550980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.551121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.551823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.552117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.552398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.552833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.565419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.567723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.581906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:10.583452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 317/632] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:10.590256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.591206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:10.592698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 316/633] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:10.600881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.603392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d463d34-96c2-4174-bff0-413d9f21e9e0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.610991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.611722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.611936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25bef6-2ba4-42a7-a2cd-38333eabda24 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.612043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.612279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.613079 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.613471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.615279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.617845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.618514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.618798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.619079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.620167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.620670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.623423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.629285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 318/634] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:10.638486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.646317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 317/635] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:10.653945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.657217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe9957-61b9-4dd9-b63f-0f2d4317ce23 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.666499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.668048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.668376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.668754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.674808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8856da5-fd5e-40ab-adf3-17642bc1455b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.681042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.681898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.682168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.682450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.682780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.684992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.704446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.706461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.721894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:36:10.727247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 319/636] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:10.731276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.738461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:10.743022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 318/637] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:10.746160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a958c-6864-4e57-9a30-2bda955daa81 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.753685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.754370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.754625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.754865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.755089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.755990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.756302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.758751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.767870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae2df5-6235-44e2-be18-9bd3fe2288ed admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.780432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.783303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.783599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.783796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.785128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:10.785471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.788526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.792488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 320/638] 10.222.0.48 () {56 vars in 1170 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:10.802102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.807074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 319/639] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:10.813603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.821321 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a9935-0ff3-457c-b940-997d9049cb67 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.827207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28d38b-9758-4eff-983d-c2cf06149e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.828085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd981c49-4d14-40cf-9b52-feef73c0cf42 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:10.828343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28d38b-9758-4eff-983d-c2cf06149e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.828986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28d38b-9758-4eff-983d-c2cf06149e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.829498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28d38b-9758-4eff-983d-c2cf06149e95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.832947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:10.833905 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.834193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.834497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/da3ce1b443aa425c99aab2ca8e6b53c8/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.836560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=da3ce1b443aa425c99aab2ca8e6b53c8, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.839360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.839765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28d38b-9758-4eff-983d-c2cf06149e95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:10.841733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28d38b-9758-4eff-983d-c2cf06149e95 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:10.851199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 321/640] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/auth/tokens => generated 1166 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:10.852980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b71f-c977-494f-81b6-fcfbafe1b587 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.853896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b71f-c977-494f-81b6-fcfbafe1b587 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.855065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 320/641] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:10 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/da3ce1b443aa425c99aab2ca8e6b53c8/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:10.855451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4b71f-c977-494f-81b6-fcfbafe1b587 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.865495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:10.865693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 322/642] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:10 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:10.870239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab92d-88e9-45f9-9d88-4b1e9350bce6 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:10.870682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab92d-88e9-45f9-9d88-4b1e9350bce6 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:10.870984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab92d-88e9-45f9-9d88-4b1e9350bce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:10.909703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-865ab92d-88e9-45f9-9d88-4b1e9350bce6 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:10.910960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-865ab92d-88e9-45f9-9d88-4b1e9350bce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:11.003049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 323/643] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:10 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:11.015302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b46dbf-f810-4d61-878d-429e9b1d213b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:11.021152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:11.022434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:11.022985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:11.023475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:11.036086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:11.038968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:11.044354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab92d-88e9-45f9-9d88-4b1e9350bce6 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:11.055252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab92d-88e9-45f9-9d88-4b1e9350bce6 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:11.067034 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:11.068726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:11.070596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:11.071105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:11.072367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:11.074563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:11.074563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:36:11.074563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:36:11.076140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:11.088694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:11.092588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 321/644] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:11.101454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:11.109267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 324/645] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:11 2021] POST /identity/v3/services => generated 251 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:11.121896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccb33-bebd-4ce1-bddb-166db6ffb7ba admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:11.140019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:11.141049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:11.141642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:11.142165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:11.143339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:11.143900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:11.145945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:11.164001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 322/646] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:11.170610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:11.183286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39673de-0380-4d51-9084-154540b5e59d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:11.188427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:11.189627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:11.190127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:11.190705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:11.199679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:11.202608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:11.219275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:11.221283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 325/647] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:11.228508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:11.247726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948b1f-903a-4bbb-acda-db254b8fbe82 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:11.260366 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52a245-050d-4804-a56a-34f9a6780797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:11.261483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52a245-050d-4804-a56a-34f9a6780797 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:11.261932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52a245-050d-4804-a56a-34f9a6780797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:11.262363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52a245-050d-4804-a56a-34f9a6780797 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:11.263727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52a245-050d-4804-a56a-34f9a6780797 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:11.264261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52a245-050d-4804-a56a-34f9a6780797 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:11.267496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52a245-050d-4804-a56a-34f9a6780797 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:11.307086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 323/648] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:11.313912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:11.331872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea10cd4-ed62-450d-b50f-a35948a98e4a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:11.341506 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365b977-235d-482a-921d-90d6912c38b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:11.342575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b977-235d-482a-921d-90d6912c38b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:11.343206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b977-235d-482a-921d-90d6912c38b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:11.343790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365b977-235d-482a-921d-90d6912c38b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:11.345125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365b977-235d-482a-921d-90d6912c38b5 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=de964adbd34c4ad482354893e9256490) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:11.345726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365b977-235d-482a-921d-90d6912c38b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:11.347815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365b977-235d-482a-921d-90d6912c38b5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:11.357960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 326/649] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:11 2021] GET /identity/v3/role_assignments?user.id=de964adbd34c4ad482354893e9256490&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:12.570896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6e25-5eb6-47c1-84f1-0cb38a0bea63 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:12.571512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6e25-5eb6-47c1-84f1-0cb38a0bea63 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:12.571587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6e25-5eb6-47c1-84f1-0cb38a0bea63 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:12.573771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 324/650] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:12.580043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e10a3c-85d8-42dc-8ca2-63ff2a844196 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:12.580457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e10a3c-85d8-42dc-8ca2-63ff2a844196 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:12.580659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e10a3c-85d8-42dc-8ca2-63ff2a844196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:12.604215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-57e10a3c-85d8-42dc-8ca2-63ff2a844196 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:12.605691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-57e10a3c-85d8-42dc-8ca2-63ff2a844196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:12.618514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 327/651] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:12 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:12.660793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6e25-5eb6-47c1-84f1-0cb38a0bea63 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:12.680263 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df6e25-5eb6-47c1-84f1-0cb38a0bea63 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:12.685530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:12.686335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:12.686622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:12.686904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:12.714252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:12.721235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:12.722827 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 325/652] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:12.729710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e10a3c-85d8-42dc-8ca2-63ff2a844196 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:12.739682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e10a3c-85d8-42dc-8ca2-63ff2a844196 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:12.758120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:12.758970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:12.759451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:12.759915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:12.760945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:12.761474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:12.763863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:12.775679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 328/653] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:12.783074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:12.799024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf10ccf-f47b-4906-8a6f-14e33825cef4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:12.810283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:12.811094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:12.811384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:12.811670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:12.833178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:12.835033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:12.859555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:12.861084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 326/654] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:12.867923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:12.883046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dfc58-34ff-419d-805f-5a9f8e12925c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:12.898315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:12.899154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:12.899527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:12.900024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:12.901356 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:12.901953 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:12.904203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:12.916764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 329/655] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:12.930503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:12.946969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4790c-164e-4823-991a-249d124f6b25 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:12.957531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:12.958508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:12.958802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:12.959086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:12.975805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:12.978063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.006415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:36:13.008241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 327/656] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:12 2021] GET /identity/v3/users/swift => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:13.014688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.040484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ef6e-68f3-4bf7-8e73-fd7a6513b2c3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.046147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.047308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.047820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.048308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.049467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:13.050063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.052285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.081646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 330/657] 10.222.0.48 () {56 vars in 1156 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:13.088237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.107001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b492-ead4-4cfa-a60c-866839ad70bd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.119205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdf6e2-f966-493f-8a28-fd3900025b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.119876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf6e2-f966-493f-8a28-fd3900025b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.120168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf6e2-f966-493f-8a28-fd3900025b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.120452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdf6e2-f966-493f-8a28-fd3900025b10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.131439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdf6e2-f966-493f-8a28-fd3900025b10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.133880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bdf6e2-f966-493f-8a28-fd3900025b10 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.148818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 328/658] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:13.155239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.170980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918eda45-45d5-4199-8f7d-62868b9fbe71 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.184066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.185944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.186706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.187439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.209411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.211779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.233638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c07f-c82c-43fc-a063-29e9c17e0f13 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.234016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c07f-c82c-43fc-a063-29e9c17e0f13 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.234215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6c07f-c82c-43fc-a063-29e9c17e0f13 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.236431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 329/659] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:13.238207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:13.239995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 331/660] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:13.243732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95064-b196-4065-9c0d-78a45a353567 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.244041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95064-b196-4065-9c0d-78a45a353567 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.245483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c95064-b196-4065-9c0d-78a45a353567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.248316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.260582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8f9c-6630-42d6-89c0-00259f4b5501 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.268511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.270221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.271049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.271605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.272991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:13.273665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.276143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.298373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 332/661] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:13.310236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.320998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-00c95064-b196-4065-9c0d-78a45a353567 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:13.323362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-00c95064-b196-4065-9c0d-78a45a353567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:13.329088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860a4d4-f83c-45ea-979d-952e40c55aba admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.336931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.338769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.339584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.340410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.352703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.355455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 330/662] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:13 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:13.356266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.372143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:13.374153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 333/663] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:13.383371 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95064-b196-4065-9c0d-78a45a353567 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.403756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.403983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c95064-b196-4065-9c0d-78a45a353567 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.416804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.417519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.417804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.418088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.418898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:13.419217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.420351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48501b-942e-410f-a47f-3bd641e9076e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.421071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.438774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.439602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.439937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.440249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.440927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.442920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.443845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 331/664] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:13.454414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.471186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995b2dd-4160-4b36-b206-d49bedc78004 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.474201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:36:13.476528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 334/665] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/services/network => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:13.483884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.486606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.489434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.490010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.490499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.492228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=5c6cef3217904adcadea1a58a7b146e1) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:13.495730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.498790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.514046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7c19-3eeb-4c6c-8397-b7b4bbd0a3c1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.516079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 332/666] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/role_assignments?user.id=5c6cef3217904adcadea1a58a7b146e1&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:13.528810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.529981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.530516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.531049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.532002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] RBAC: Adding query filter params (name=network) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:13.532549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.534738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.541115 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 335/667] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/services?name=network => generated 124 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:13.550043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.568565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a749f8-5fe4-4918-be86-93b5e503ffba admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.574893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.576265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.577102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.577605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.578519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] RBAC: Adding query filter params (type=network) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:13.579058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.580931 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.591873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 333/668] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/services?type=network => generated 350 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:13.600107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.612938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29d6e-4f28-4c7b-8adf-c2ff5cea2e10 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.622613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.623686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.624204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.624720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.626224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] RBAC: Adding query filter params (interface=public, service_id=83ab83e91f3840658869bdfe1582f880, region_id=RegionOne) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:13.627091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.629076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:13.629076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:36:13.629076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:36:13.631394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd001c-0f32-4525-9f06-aa1d7b477212 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.650622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 336/669] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/endpoints?service_id=83ab83e91f3840658869bdfe1582f880&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:13.658675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:13.677711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7106-4657-4d41-9479-3985350fd886 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:13.696005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1478597-5278-4e32-8ee1-bb1c4b3fc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:13.696738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478597-5278-4e32-8ee1-bb1c4b3fc785 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.697027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478597-5278-4e32-8ee1-bb1c4b3fc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.697310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1478597-5278-4e32-8ee1-bb1c4b3fc785 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.698117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1478597-5278-4e32-8ee1-bb1c4b3fc785 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:13.699976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1478597-5278-4e32-8ee1-bb1c4b3fc785 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:13.718809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 334/670] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:13 2021] GET /identity/v3/services => generated 772 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:13.955673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773eb0f-b040-4da5-8663-2de944390ec4 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.955907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773eb0f-b040-4da5-8663-2de944390ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.956358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773eb0f-b040-4da5-8663-2de944390ec4 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.958324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 337/671] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:13.964874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad46bd-3b57-402a-aa74-819a5480b1fc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:13.965283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad46bd-3b57-402a-aa74-819a5480b1fc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:13.965578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad46bd-3b57-402a-aa74-819a5480b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:13.988623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-11ad46bd-3b57-402a-aa74-819a5480b1fc None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:13.989897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-11ad46bd-3b57-402a-aa74-819a5480b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:13.999898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 335/672] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:13 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:14.036252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773eb0f-b040-4da5-8663-2de944390ec4 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.060002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773eb0f-b040-4da5-8663-2de944390ec4 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.064628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.065457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.065747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.066026 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.081107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:14.088158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:14.089650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 338/673] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:14.098408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad46bd-3b57-402a-aa74-819a5480b1fc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.109450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad46bd-3b57-402a-aa74-819a5480b1fc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.122128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.122806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.123091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.123370 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.124178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:14.124490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.126165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.141212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 336/674] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:14.148664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.162213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5e770-8ac0-47a5-af48-98332da44114 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.178277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.179674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.179960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.180237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.192642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.194586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.232436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:14.233958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 339/675] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:14.240251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.259598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716424d9-ed21-42e7-863e-01e4d57571f2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.267490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.268169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.268454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.268735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.269496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:14.269805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.271490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.295729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 337/676] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:14.306098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.323596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203fff4-0ba8-4f63-b0ab-9ce45190b202 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.338526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.339899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.340409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.340910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.354873 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.365601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.385840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:36:14.387083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 340/677] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:14.393691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.411580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5d76f-4fbf-4701-9171-7339fac47753 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.419720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.420378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.420666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.420947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.421848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:14.422158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.424021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.453949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 338/678] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:14.464283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.474853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedf333-013f-4a81-9eec-c516b5d1fc25 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.489694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.490692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.491134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.491429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.508841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.510995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.526570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 341/679] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:14.532945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.547181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d065f1a-c809-4295-a647-841404a3f91b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.558054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.558762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.559049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.559331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.575333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.578830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.607435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:14.616245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 339/680] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:14.620250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.636445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3262d8a-6730-40aa-b79b-42bbfd0345e0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.648200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.649337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.649886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.650388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.651752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:14.652313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.655374 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.677666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 342/681] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:14.683956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.700286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e1fe3-6fd5-474f-9d85-608d24dbc3f6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.710808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3384f5e-d5f2-4ab4-9bfd-e6c4b43a9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.711656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3384f5e-d5f2-4ab4-9bfd-e6c4b43a9d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.711957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3384f5e-d5f2-4ab4-9bfd-e6c4b43a9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.712335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3384f5e-d5f2-4ab4-9bfd-e6c4b43a9d69 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.724995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3384f5e-d5f2-4ab4-9bfd-e6c4b43a9d69 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.727137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3384f5e-d5f2-4ab4-9bfd-e6c4b43a9d69 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.744758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-a3384f5e-d5f2-4ab4-9bfd-e6c4b43a9d69 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:14.745926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 340/682] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:14.772117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.783168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3793551-ea87-4b4e-93da-a74100a3b77e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.785349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcad0e-9899-4f42-9db2-d5526fb20e89 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.785723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcad0e-9899-4f42-9db2-d5526fb20e89 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.785953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcad0e-9899-4f42-9db2-d5526fb20e89 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.787711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 341/683] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:14.795745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a098cf4-3f40-4a0a-827a-aea48194205e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.796052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a098cf4-3f40-4a0a-827a-aea48194205e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.796298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a098cf4-3f40-4a0a-827a-aea48194205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.801976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.802645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.802933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.803210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.804042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:14.804350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.806242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.830449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:14.835777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4a098cf4-3f40-4a0a-827a-aea48194205e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:14.837416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4a098cf4-3f40-4a0a-827a-aea48194205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:14.838034 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.846018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 342/685] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:14 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:14.854003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9022e60-4872-4348-8663-c1228854c53d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.861353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb685f9-a64e-407b-8dc5-0429a0c1a701 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.861753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb685f9-a64e-407b-8dc5-0429a0c1a701 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.862041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb685f9-a64e-407b-8dc5-0429a0c1a701 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.863994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 343/686] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:14.871391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb685f9-a64e-407b-8dc5-0429a0c1a701 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.872240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c03aaf-56cb-483a-a1a1-25609d2bac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.872910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03aaf-56cb-483a-a1a1-25609d2bac3d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.873194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03aaf-56cb-483a-a1a1-25609d2bac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.873563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c03aaf-56cb-483a-a1a1-25609d2bac3d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.874683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c03aaf-56cb-483a-a1a1-25609d2bac3d admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=da3ce1b443aa425c99aab2ca8e6b53c8) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:14.875009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c03aaf-56cb-483a-a1a1-25609d2bac3d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.877062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c03aaf-56cb-483a-a1a1-25609d2bac3d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.891030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 344/687] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/role_assignments?user.id=da3ce1b443aa425c99aab2ca8e6b53c8&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:14.893158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775a31-cb5d-48b1-8d9c-e78c55a07d4d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.893571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775a31-cb5d-48b1-8d9c-e78c55a07d4d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.893943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b775a31-cb5d-48b1-8d9c-e78c55a07d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.894318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb685f9-a64e-407b-8dc5-0429a0c1a701 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.910782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.912181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.912944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.913586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.914481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.917961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:14.942572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:36:14.944601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2b775a31-cb5d-48b1-8d9c-e78c55a07d4d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:14.944752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 344/688] 10.222.0.48 () {56 vars in 1150 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:14.946199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2b775a31-cb5d-48b1-8d9c-e78c55a07d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:14.957541 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:14.962889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 345/689] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:14 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:14.979033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b73d-2e8f-459b-80ab-bf4410f1412f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:14.988972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:14.989740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:14.990030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:14.990326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:14.991111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:14.991422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:14.993114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.008355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 345/690] 10.222.0.48 () {56 vars in 1145 bytes} [Tue Oct 12 16:36:14 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:15.012942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775a31-cb5d-48b1-8d9c-e78c55a07d4d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.023127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.032949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b775a31-cb5d-48b1-8d9c-e78c55a07d4d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.040751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac5f24-05d6-4909-9c78-54d24ed12476 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.044443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.045818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.046269 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.046710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.056676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.057772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.058275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.058675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.065419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:15.065419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.065419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.074364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 346/691] 10.222.0.48 () {56 vars in 1145 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:15.082522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.088362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:15.103868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b28a-4a98-4a63-aa6b-865a18ed515c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.106819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:15.111982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.112870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.113188 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.113504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.114480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] RBAC: Adding query filter params (interface=public, service_id=141dfde6f0bc405a914eec6ca116abb2, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:15.114801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.116461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:15.116461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:36:15.116461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:36:15.117624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.119792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 346/692] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:15.120920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.137145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34a50-e0c5-4c20-8779-a3529114561a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.141143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 347/693] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/endpoints?service_id=141dfde6f0bc405a914eec6ca116abb2&interface=public®ion_id=RegionOne => generated 194 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:15.145793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.146502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.146788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.147069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.147881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:15.148187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.149311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.149815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.163740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65351ec-08f0-427d-86af-2e98c2bb7086 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.170799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 347/694] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:15.177648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50675816-6914-4db1-a93c-439448301bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.177905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.180061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675816-6914-4db1-a93c-439448301bff admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.180686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675816-6914-4db1-a93c-439448301bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.181182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50675816-6914-4db1-a93c-439448301bff admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.182149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50675816-6914-4db1-a93c-439448301bff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.184731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50675816-6914-4db1-a93c-439448301bff admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.195319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 348/695] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/services => generated 772 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:15.203179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961bd3-626b-4bf7-9001-3f162311b6de admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.212120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.212939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.213232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.213549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.232711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.234725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.255722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:15.257909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 348/696] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:15.264344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50675816-6914-4db1-a93c-439448301bff admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.281139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50675816-6914-4db1-a93c-439448301bff admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.290498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.291687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.292140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.292461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.293318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:15.293705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.295415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.310171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 349/697] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:15.316907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.329293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec7b06-25e2-47c9-9a7e-95c6ad777eda admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.334914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.336117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.336552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.337023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.346097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.348550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.365361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:36:15.367565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 349/698] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:15.375924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.396286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9b97-7ccb-461c-bc10-4076a47c3f61 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.405167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.406140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.406700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.407235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.408540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:15.409018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.411146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.439854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 350/699] 10.222.0.48 () {56 vars in 1170 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:15.447023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.463796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381bfd2-82c6-445f-82a9-ace6605417cf admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.472266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.473532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.474146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.474463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.487886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.490039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.512606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:15.513789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 350/700] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:15.520767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.531406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0b94a-7a7a-4212-9cda-0022e79e84d3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.543152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.543841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.544133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.544422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.545177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:15.545530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.547154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.561278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 351/701] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:15.567191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.585167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff919db2-42dc-4ebf-8f51-1aa90c190e64 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.593762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.595095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.595786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.596380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.612008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.614382 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.637664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:15.640056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 351/702] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:15.647099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.664577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ce1ac-3dad-4dda-9e66-5195fbd4c8c6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.672542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea2969-15f7-4f95-8296-d076f5ba35b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.673604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2969-15f7-4f95-8296-d076f5ba35b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.674071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2969-15f7-4f95-8296-d076f5ba35b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.674539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2969-15f7-4f95-8296-d076f5ba35b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.675592 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea2969-15f7-4f95-8296-d076f5ba35b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:15.676082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea2969-15f7-4f95-8296-d076f5ba35b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.678237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea2969-15f7-4f95-8296-d076f5ba35b2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.696979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 352/703] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:15.704601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:15.719313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f654b89-d134-411a-a9fb-0b59bf9adb7e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:15.724759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889b81d-c3f1-4bc5-b3c3-905cbd597056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:15.726463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b81d-c3f1-4bc5-b3c3-905cbd597056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:15.727004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b81d-c3f1-4bc5-b3c3-905cbd597056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:15.727455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b81d-c3f1-4bc5-b3c3-905cbd597056 admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/de964adbd34c4ad482354893e9256490/roles/b0384dab922047ac99e3d88dcd0535a3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:15.751536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889b81d-c3f1-4bc5-b3c3-905cbd597056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=de964adbd34c4ad482354893e9256490, role_id=b0384dab922047ac99e3d88dcd0535a3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:15.754633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889b81d-c3f1-4bc5-b3c3-905cbd597056 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:15.774100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 352/704] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:15 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/de964adbd34c4ad482354893e9256490/roles/b0384dab922047ac99e3d88dcd0535a3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:16.749418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3431fc-d8b3-404a-a3bf-ec13f8160b0b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:16.750604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3431fc-d8b3-404a-a3bf-ec13f8160b0b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:16.751174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3431fc-d8b3-404a-a3bf-ec13f8160b0b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:16.753596 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 353/705] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:16.761806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30dc8b-6fc6-4292-931a-ed99d371cc7d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:16.762920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30dc8b-6fc6-4292-931a-ed99d371cc7d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:16.763436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30dc8b-6fc6-4292-931a-ed99d371cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:16.790538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-aa30dc8b-6fc6-4292-931a-ed99d371cc7d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:16.792118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-aa30dc8b-6fc6-4292-931a-ed99d371cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:16.875341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 353/706] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:16 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:16.919663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3431fc-d8b3-404a-a3bf-ec13f8160b0b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:16.943889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3431fc-d8b3-404a-a3bf-ec13f8160b0b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:16.952991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:16.954259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:16.954867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:16.955365 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:16.971609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:16.979142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:16.980705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 354/707] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:16.987308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30dc8b-6fc6-4292-931a-ed99d371cc7d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:16.996947 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30dc8b-6fc6-4292-931a-ed99d371cc7d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.004223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.004933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.005223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.005570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.006370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:17.006634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.008823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.019061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 354/708] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:17.027893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.042029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980032be-9c4a-4953-b030-b734737eab2d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.049762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be313dcf-ca44-46a3-9ff7-458ed6e83a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.050902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be313dcf-ca44-46a3-9ff7-458ed6e83a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.051334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be313dcf-ca44-46a3-9ff7-458ed6e83a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.051756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be313dcf-ca44-46a3-9ff7-458ed6e83a55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.070564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be313dcf-ca44-46a3-9ff7-458ed6e83a55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.072753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be313dcf-ca44-46a3-9ff7-458ed6e83a55 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.097365 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-be313dcf-ca44-46a3-9ff7-458ed6e83a55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:17.099231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 355/709] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:17.108757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.119207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea45e-9b70-48c8-8068-b965a23b6f98 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.119722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea45e-9b70-48c8-8068-b965a23b6f98 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.120148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aea45e-9b70-48c8-8068-b965a23b6f98 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.122205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 356/710] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:17 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:17.131122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c16c1-0b37-41c6-8312-020e6a4797c3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.132182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c16c1-0b37-41c6-8312-020e6a4797c3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.132605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c16c1-0b37-41c6-8312-020e6a4797c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.136563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec90c4-2d8a-4a31-a244-e380557c7c4a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.148561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.149591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.152575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.153071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.156290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:17.156821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.159730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.172439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2f5c16c1-0b37-41c6-8312-020e6a4797c3 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:17.174079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2f5c16c1-0b37-41c6-8312-020e6a4797c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:17.184404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 355/711] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:17.193890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.195019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 357/712] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:17 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:17.210760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b64616-c763-4162-9043-c663a358e53d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.221807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.222904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.223558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.224237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.230663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c16c1-0b37-41c6-8312-020e6a4797c3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.244004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c16c1-0b37-41c6-8312-020e6a4797c3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.246561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.253507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.253507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.253507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.253507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] PATH_INFO: `/v3/services/network` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.254134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.255312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.256048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.268602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 16:36:17.271333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 358/713] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:17.283471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.283933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:36:17.285718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 356/714] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/users/swift => generated 83 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:17.289432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b84f9-984d-4558-b410-a6d9ed43edaf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.292490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.295585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.296440 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.296858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.297249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.298182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] RBAC: Adding query filter params (name=network) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:17.305416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.305416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.309595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 359/715] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:17.311706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d87e7-c0dd-4f7f-a6d3-d77633172bcc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.316985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.328559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d255e-2288-4fd9-a1de-73ed67c3693e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.329492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.330464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.331023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.331552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.332652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:17.333118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.334302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.335728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.336132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.336275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.336597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.337947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] RBAC: Adding query filter params (type=network) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:17.341396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.341396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.348051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 360/716] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:17.354585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.368066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80121c4-e9db-4c94-9df1-d95ec1e7383e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.372890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 357/717] 10.222.0.48 () {56 vars in 1156 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:17.376722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.376722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.376722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.376722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.377071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.377837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:17.377837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:36:17.377837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:36:17.378846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.383047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.398788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa07846-c029-435d-b807-9b81334bed81 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.406924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 361/718] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:17 2021] POST /identity/v3/endpoints => generated 327 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:17.455043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.456290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.456739 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.457172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.487904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.491788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.530400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:17.531903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 358/719] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:17.539089 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.560277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069b5fb-ef69-4adb-b6e3-b481c49a5558 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.567512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.568268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.568599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.568882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.570247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:17.570559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.572835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.588327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 362/720] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:17.594581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.615644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8be85-f50a-460a-9faf-2ae9c1ea4fd8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.630220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.631039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.631320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.631589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.646866 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.649473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.667455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:17.669092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 359/721] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:17.675408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.687792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dad78-517f-43a4-820f-766e0b0e5630 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.698848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926887a6-f209-474f-870b-12d77b33bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.700019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926887a6-f209-474f-870b-12d77b33bcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.700488 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926887a6-f209-474f-870b-12d77b33bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.701030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926887a6-f209-474f-870b-12d77b33bcc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.702020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926887a6-f209-474f-870b-12d77b33bcc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:17.702603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926887a6-f209-474f-870b-12d77b33bcc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.707626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926887a6-f209-474f-870b-12d77b33bcc9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.718968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 363/722] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:17.730059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:17.750043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebf474-4129-4795-81e5-580fe80f6c34 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:17.758727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00c2c2-a049-4cb7-83db-828d0af226df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:17.759565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c2c2-a049-4cb7-83db-828d0af226df admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:17.759846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c2c2-a049-4cb7-83db-828d0af226df admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:17.760119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00c2c2-a049-4cb7-83db-828d0af226df admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/5c6cef3217904adcadea1a58a7b146e1/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:17.762255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c2c2-a049-4cb7-83db-828d0af226df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=5c6cef3217904adcadea1a58a7b146e1, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:17.765281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00c2c2-a049-4cb7-83db-828d0af226df admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:17.789456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 360/723] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:17 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/5c6cef3217904adcadea1a58a7b146e1/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:18.346043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06dad-6683-42a2-bdef-39ce58d698d2 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.346748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06dad-6683-42a2-bdef-39ce58d698d2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.346748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d06dad-6683-42a2-bdef-39ce58d698d2 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.348659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 364/724] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:18.354996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fba5b-564c-46b9-8852-a0edeae427da None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.355287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fba5b-564c-46b9-8852-a0edeae427da None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.355568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fba5b-564c-46b9-8852-a0edeae427da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.374654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f04fba5b-564c-46b9-8852-a0edeae427da None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:18.375865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f04fba5b-564c-46b9-8852-a0edeae427da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:18.436520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 361/725] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:18 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:18.461119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06dad-6683-42a2-bdef-39ce58d698d2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.474935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d06dad-6683-42a2-bdef-39ce58d698d2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.480721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.482176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.482754 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.483255 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.484197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.486238 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.499851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:36:18.505522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 365/726] 10.222.0.48 () {56 vars in 1153 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:18.509218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fba5b-564c-46b9-8852-a0edeae427da None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.519085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04fba5b-564c-46b9-8852-a0edeae427da None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.524171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee9717-ffec-49d4-819a-6f673b6f0ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.525081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee9717-ffec-49d4-819a-6f673b6f0ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.525644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee9717-ffec-49d4-819a-6f673b6f0ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.526136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee9717-ffec-49d4-819a-6f673b6f0ff0 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.527066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee9717-ffec-49d4-819a-6f673b6f0ff0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:18.527580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee9717-ffec-49d4-819a-6f673b6f0ff0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.529598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee9717-ffec-49d4-819a-6f673b6f0ff0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.540741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 362/727] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:18.542403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.552620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200c2a-86bc-455b-bf54-566b6e152611 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.558243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf6d8d-a3ef-4b14-b4ef-14ef957275a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.559159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf6d8d-a3ef-4b14-b4ef-14ef957275a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.559687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf6d8d-a3ef-4b14-b4ef-14ef957275a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.560178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf6d8d-a3ef-4b14-b4ef-14ef957275a2 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.561142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf6d8d-a3ef-4b14-b4ef-14ef957275a2 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:18.561711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf6d8d-a3ef-4b14-b4ef-14ef957275a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.563566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf6d8d-a3ef-4b14-b4ef-14ef957275a2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.573558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 366/728] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:18.618670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de231f-cde8-4134-93eb-3b6b82e91fa5 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.619282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de231f-cde8-4134-93eb-3b6b82e91fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.619774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de231f-cde8-4134-93eb-3b6b82e91fa5 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.622221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 363/729] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:18.628195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e0539-8a10-4894-8600-9f58bd1b9d4d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.628487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e0539-8a10-4894-8600-9f58bd1b9d4d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.628774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e0539-8a10-4894-8600-9f58bd1b9d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.647300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024ef49-fb97-4f03-8996-f9ca6cd4ca08 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.647660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024ef49-fb97-4f03-8996-f9ca6cd4ca08 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.647894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024ef49-fb97-4f03-8996-f9ca6cd4ca08 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.650162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 364/730] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:18.651100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-cb1e0539-8a10-4894-8600-9f58bd1b9d4d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:18.652361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cb1e0539-8a10-4894-8600-9f58bd1b9d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:18.660682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76fef-1f22-47f2-9ba0-77208bd03493 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.661028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76fef-1f22-47f2-9ba0-77208bd03493 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.661262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76fef-1f22-47f2-9ba0-77208bd03493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.666032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 367/731] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:18 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:18.681887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-71e76fef-1f22-47f2-9ba0-77208bd03493 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:18.683169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-71e76fef-1f22-47f2-9ba0-77208bd03493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:18.691839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 365/732] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:18 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:18.693299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e0539-8a10-4894-8600-9f58bd1b9d4d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.703870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e0539-8a10-4894-8600-9f58bd1b9d4d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.709012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.710288 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.710810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.711289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.719928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e76fef-1f22-47f2-9ba0-77208bd03493 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.724023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:18.730748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e76fef-1f22-47f2-9ba0-77208bd03493 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.732702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:36:18.734544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 368/733] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:18.740199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.740199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.740199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.740199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.740610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.740610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.742654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.753282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268d6f-ae79-42ff-9d4c-396decbf7cca admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.754643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 16:36:18.756303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 366/734] 10.222.0.48 () {56 vars in 1150 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:18.759266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.760193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.760701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.761142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.762407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:18.762867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.763094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.765460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.775052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daa98c-5a0d-4935-a33b-52c56a0488e7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.776338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 369/735] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:18.782862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.783049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.784500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.785144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.785894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.787484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:18.788793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.793425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.795587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d780-40f9-40de-bf68-b71f92b0847f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.802844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 367/736] 10.222.0.48 () {56 vars in 1145 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:18.809318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.810517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.810517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.810698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.812303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.822982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84526252-1fe5-4dcb-8222-90731dd433df admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.823165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.824982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.828517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.829445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.829881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.830306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.831173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:18.831653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.833401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.839817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 368/737] 10.222.0.48 () {56 vars in 1145 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:18.844317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:18.845562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.845798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 370/738] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:18.852336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.857042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f87d89-fe5b-4e06-ac26-7578dd3265d5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.861979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.862898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.863353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.863788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.864079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0976821-dc92-4904-b57b-0bf7a94e4117 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.864887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.866187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:18.866187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:36:18.866187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:36:18.867394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.869491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.870204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.870710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.871106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.871916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:18.872294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.874626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.890594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 371/739] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:18.896238 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.897954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 369/740] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:18 2021] POST /identity/v3/endpoints => generated 346 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:18.911243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fcc6f-7d27-4a3c-90ff-66daf4c8ccd0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.928255 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.929455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.929885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.930294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.942654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.945176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:18.962321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:36:18.964513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 372/741] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:18.970548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:18.983863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76617f87-b671-4aad-a671-4834b5efd398 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:18.989418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:18.990468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:18.990948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:18.991449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:18.992526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:18.993025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:18.995303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:19.017674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 370/742] 10.222.0.48 () {56 vars in 1170 bytes} [Tue Oct 12 16:36:18 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:19.029197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:19.040174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa8631-dfc8-4cfd-ac12-5037fc8155da admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:19.045177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:19.045891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:19.046179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:19.046462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:19.055495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:19.057595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:19.068336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 373/743] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:19 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:19.075109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:19.086503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e5117-6ecc-453c-b4b6-5461c67daff7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:19.091611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:19.092430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:19.092713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:19.092988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:19.106787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:19.108789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:19.128450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:19.130012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 371/744] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:19.136113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:19.147183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504fad3-46eb-487d-82eb-47cb78c67cfb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:19.153323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:19.154027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:19.154314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:19.154588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:19.155324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:19.155626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:19.157197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:19.170670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 374/745] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:19.176770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:19.186914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80253f-41ea-434b-9dd9-fbf7ba53a6a3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:19.191430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:19.192218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:19.192496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:19.192769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:19.200551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:19.202878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:19.217547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:19.219057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 372/746] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:19.225321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:19.235576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8b597-fab6-4de1-aad4-e665dd638e4e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:19.241956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262863b-52e1-4625-9ad0-6a84b0295832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:19.242620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262863b-52e1-4625-9ad0-6a84b0295832 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:19.242903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262863b-52e1-4625-9ad0-6a84b0295832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:19.243317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262863b-52e1-4625-9ad0-6a84b0295832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:19.244122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262863b-52e1-4625-9ad0-6a84b0295832 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:19.244432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262863b-52e1-4625-9ad0-6a84b0295832 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:19.246304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262863b-52e1-4625-9ad0-6a84b0295832 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:19.259227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 375/747] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:19.265665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:19.279399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120d77e-ad9e-46ae-b8b7-c05f8c449e6a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:19.283983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d967a4c-1dbe-4d51-8dcd-44a572874f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:19.284622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967a4c-1dbe-4d51-8dcd-44a572874f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:19.284904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967a4c-1dbe-4d51-8dcd-44a572874f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:19.285177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d967a4c-1dbe-4d51-8dcd-44a572874f9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:19.286051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967a4c-1dbe-4d51-8dcd-44a572874f9d admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=de964adbd34c4ad482354893e9256490) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:19.286363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967a4c-1dbe-4d51-8dcd-44a572874f9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:19.288756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d967a4c-1dbe-4d51-8dcd-44a572874f9d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:19.295197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 373/748] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:19 2021] GET /identity/v3/role_assignments?user.id=de964adbd34c4ad482354893e9256490&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:20.252522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e76869-f610-4c62-a16a-6b6862a30aeb None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.253215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e76869-f610-4c62-a16a-6b6862a30aeb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.253215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e76869-f610-4c62-a16a-6b6862a30aeb None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.255101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 376/749] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:20.262131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd297-0259-44fe-8db4-9b334246d417 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.262711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd297-0259-44fe-8db4-9b334246d417 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.262711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffd297-0259-44fe-8db4-9b334246d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.282402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-6cffd297-0259-44fe-8db4-9b334246d417 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:20.283635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6cffd297-0259-44fe-8db4-9b334246d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:20.292065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 374/750] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:20 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:20.317149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e76869-f610-4c62-a16a-6b6862a30aeb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.330864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e76869-f610-4c62-a16a-6b6862a30aeb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.335374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.336168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.336453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.336732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.347889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:20.355081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:20.356641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 377/751] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:20.365790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffd297-0259-44fe-8db4-9b334246d417 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.378100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffd297-0259-44fe-8db4-9b334246d417 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.384822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.385537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.385832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.386114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.387078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:20.387398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.388999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.400029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 375/752] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:20.407542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.419547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510b2a2-dd5f-41fa-bab9-47d7311adaa4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.424306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.425224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.425565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.425855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.441050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.443394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.465513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:20.467103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 378/753] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:20.473552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.483637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03adce-840c-40ec-b59d-fe86875140c4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.488337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.489012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.489297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.489608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.490357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:20.490663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.492865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.506276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 376/754] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:20.513346 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.523389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c51a-fee4-4efb-b19a-5288965219c6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.528245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.529060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.529348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.529659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.537770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.539856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.556313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 16:36:20.557896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 379/755] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:20.564507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.575573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b7cab-05d3-4282-85d6-3b8465f8cb70 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.580723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.581484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.581771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.582051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.582920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:20.583238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.585137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.605121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 377/756] 10.222.0.48 () {56 vars in 1156 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:20.611947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.623637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f2934-4aec-48ca-ad67-bba44d9464fd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.628686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.629417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.629714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.629993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.640190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.642177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.653242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 380/757] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:20.660318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.671296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a921b7-0627-410a-adae-bebba0f730b8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.676306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.677400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.677695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.677974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.690351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.692582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.713027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:20.714633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 378/758] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:20.721302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.732264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3eae1-1964-4f25-a3f0-bedc88a7ad4c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.737306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.738046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.738333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.738661 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.739544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:20.740101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.742448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.755938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 381/759] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:20.763654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.778525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c898-8039-4b16-9603-663a13ee6008 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.785410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.786647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.787070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.787480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.799151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.802461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.826826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:20.833521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 379/760] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:20.839765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.853699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f9da9-5696-4c7b-bf01-8c4d96607b03 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.858600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c29730-ad93-477a-928c-657a15675f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.859285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29730-ad93-477a-928c-657a15675f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.859577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29730-ad93-477a-928c-657a15675f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.859858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29730-ad93-477a-928c-657a15675f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.860694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c29730-ad93-477a-928c-657a15675f07 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:20.861014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c29730-ad93-477a-928c-657a15675f07 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.863099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c29730-ad93-477a-928c-657a15675f07 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.878750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 382/761] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:20.889214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:20.905551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739fce-715d-4687-ae96-3a98a3437f1f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:20.912253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c076-b29b-45aa-b965-00eee1d15ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:20.913804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c076-b29b-45aa-b965-00eee1d15ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:20.914237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c076-b29b-45aa-b965-00eee1d15ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:20.914657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c076-b29b-45aa-b965-00eee1d15ce2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:20.916045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c076-b29b-45aa-b965-00eee1d15ce2 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=5c6cef3217904adcadea1a58a7b146e1) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:20.916592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c076-b29b-45aa-b965-00eee1d15ce2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:20.919698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c076-b29b-45aa-b965-00eee1d15ce2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:20.930560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 380/762] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:20 2021] GET /identity/v3/role_assignments?user.id=5c6cef3217904adcadea1a58a7b146e1&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:21.036243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a872b-efbc-43c6-8a00-83493b24b92d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.036493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a872b-efbc-43c6-8a00-83493b24b92d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.036731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a872b-efbc-43c6-8a00-83493b24b92d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.039552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 383/763] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:21.046472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062923e-8292-4616-8404-e249f8bef452 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.046766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062923e-8292-4616-8404-e249f8bef452 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.047051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062923e-8292-4616-8404-e249f8bef452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.067136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7062923e-8292-4616-8404-e249f8bef452 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:21.068392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7062923e-8292-4616-8404-e249f8bef452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:21.077341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 381/764] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:21 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:21.103917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a872b-efbc-43c6-8a00-83493b24b92d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:21.117419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a872b-efbc-43c6-8a00-83493b24b92d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:21.122597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475cdda-65e3-4b58-a8da-91666b2aa508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:21.123277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475cdda-65e3-4b58-a8da-91666b2aa508 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.123620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475cdda-65e3-4b58-a8da-91666b2aa508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.123906 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475cdda-65e3-4b58-a8da-91666b2aa508 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.124724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475cdda-65e3-4b58-a8da-91666b2aa508 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:21.126497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475cdda-65e3-4b58-a8da-91666b2aa508 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:21.143798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 384/765] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:21 2021] POST /identity/v3/services => generated 269 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:21.402217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6b4a-a95e-4803-8b56-80476d03fefd None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.402712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6b4a-a95e-4803-8b56-80476d03fefd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.402712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6b4a-a95e-4803-8b56-80476d03fefd None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.404622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 382/766] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:21.411262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bac75-3d40-401d-ab7b-1016c6b6d023 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.412266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bac75-3d40-401d-ab7b-1016c6b6d023 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.412806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bac75-3d40-401d-ab7b-1016c6b6d023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.432920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-895bac75-3d40-401d-ab7b-1016c6b6d023 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:21.434672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-895bac75-3d40-401d-ab7b-1016c6b6d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:21.454844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 385/767] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:21 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:21.480200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6b4a-a95e-4803-8b56-80476d03fefd None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:21.493720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6b4a-a95e-4803-8b56-80476d03fefd None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:21.503193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:21.504378 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.504867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.505413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.506320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:21.509102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:21.520870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:36:21.523201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 383/768] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:21 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:21.530185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bac75-3d40-401d-ab7b-1016c6b6d023 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:21.539518 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bac75-3d40-401d-ab7b-1016c6b6d023 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:21.544552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e105c3e-4f64-4175-bf68-bacc0eb4a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:21.545550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e105c3e-4f64-4175-bf68-bacc0eb4a365 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.546036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e105c3e-4f64-4175-bf68-bacc0eb4a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.546523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e105c3e-4f64-4175-bf68-bacc0eb4a365 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.547456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e105c3e-4f64-4175-bf68-bacc0eb4a365 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:21.547964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e105c3e-4f64-4175-bf68-bacc0eb4a365 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:21.549771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e105c3e-4f64-4175-bf68-bacc0eb4a365 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:21.555281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 386/769] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:21 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:21.561804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:21.572290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d59435-a4af-49f9-887f-2f401091ab99 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:21.577200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a234b32-9fa8-4317-9a04-6d44b0ea6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:21.578398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234b32-9fa8-4317-9a04-6d44b0ea6846 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.578878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234b32-9fa8-4317-9a04-6d44b0ea6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.579366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a234b32-9fa8-4317-9a04-6d44b0ea6846 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.580288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a234b32-9fa8-4317-9a04-6d44b0ea6846 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:21.580785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a234b32-9fa8-4317-9a04-6d44b0ea6846 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:21.582593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a234b32-9fa8-4317-9a04-6d44b0ea6846 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:21.588242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 384/770] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:21 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:21.828817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723bc52-4241-4ae3-a3de-744aa3eca7d5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.829196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723bc52-4241-4ae3-a3de-744aa3eca7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.829416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723bc52-4241-4ae3-a3de-744aa3eca7d5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.831514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 387/771] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:21.837733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301be70-b0bf-456d-acb8-661c41e88214 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.838086 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301be70-b0bf-456d-acb8-661c41e88214 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.838304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301be70-b0bf-456d-acb8-661c41e88214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.857644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2301be70-b0bf-456d-acb8-661c41e88214 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:21.858856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2301be70-b0bf-456d-acb8-661c41e88214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:21.873482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 385/772] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:21 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:21.892465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723bc52-4241-4ae3-a3de-744aa3eca7d5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:21.905015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723bc52-4241-4ae3-a3de-744aa3eca7d5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:21.909520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:21.910380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.910671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.910951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.921886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:21.929970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:36:21.931423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 388/773] 10.222.0.48 () {56 vars in 1141 bytes} [Tue Oct 12 16:36:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:21.937917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301be70-b0bf-456d-acb8-661c41e88214 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:21.948062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301be70-b0bf-456d-acb8-661c41e88214 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:21.953063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:21.953769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.954056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.954397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:21.955165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:21.955525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:21.957133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:21.971690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 386/774] 10.222.0.48 () {56 vars in 1136 bytes} [Tue Oct 12 16:36:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:21.973047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:21.983705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91143df0-a499-4d3a-b24f-20c97ddf658b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:21.988376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:21.989161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:21.989489 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:21.989768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.008149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.010214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.027394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:22.028919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 389/775] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:22.035234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.045647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb14f9c-442a-40ea-8e2a-513b62b37021 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.050650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.051570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.052068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.052545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.053549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:22.054590 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.056394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.074989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 387/776] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:22.076641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.091007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad03f8-e169-4270-a951-410a3006c068 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.095724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.096535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.096821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.097183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.105422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.107471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.124100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:36:22.125650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 390/777] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:22.132558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.143181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5aea5-fbc0-4842-82f9-cda6d7bee663 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.148151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.149094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.149633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.150133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.151260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:22.151818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.153997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.176016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 388/778] 10.222.0.48 () {56 vars in 1170 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:22.179773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.189932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8a0e4-8438-4853-be56-974aa0aa0b64 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.195375 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.196274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.196765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.197278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.206437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.208592 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.219283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 391/779] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:22.226633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.236960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9174c-19ef-4b2b-bf55-1c35ec056c28 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.242470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.243532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.244102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.244601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.255674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.257910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.275450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:22.281487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 389/780] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:22.283952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.293944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe02cb-4ce3-44d3-b2e7-2c479cb9b013 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.299008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.299947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.300470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.300991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.301964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:22.302478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.304899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.322480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 392/781] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:22.327309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.340429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c7524-f0ee-4299-ac40-46c934b3236c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.345840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.346959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.347506 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.348010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.357743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.360132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.377613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:22.384265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 390/782] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:22.386809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.397202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57648cc-31cf-4579-b212-63d8f4bcc47d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.408171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f3d50-e253-4feb-867b-f15706295a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.409800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3d50-e253-4feb-867b-f15706295a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.410524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3d50-e253-4feb-867b-f15706295a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.411259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3d50-e253-4feb-867b-f15706295a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.412975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f3d50-e253-4feb-867b-f15706295a20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:22.414876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f3d50-e253-4feb-867b-f15706295a20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.417358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f3d50-e253-4feb-867b-f15706295a20 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.436800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 393/783] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:22.439589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:22.453914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e24fa-9156-4dff-9918-f3cc07481c35 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:22.459787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346452ee-e776-45b5-b9f7-cc40dba4c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:22.460816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346452ee-e776-45b5-b9f7-cc40dba4c39d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:22.461555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346452ee-e776-45b5-b9f7-cc40dba4c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:22.461988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346452ee-e776-45b5-b9f7-cc40dba4c39d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:22.463084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346452ee-e776-45b5-b9f7-cc40dba4c39d admin admin] RBAC: Adding query filter params (role.id=a495b5a0c90d469ba925602a6773bed9, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=de964adbd34c4ad482354893e9256490) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:22.463556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346452ee-e776-45b5-b9f7-cc40dba4c39d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:22.465665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346452ee-e776-45b5-b9f7-cc40dba4c39d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:22.477580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 391/784] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:22 2021] GET /identity/v3/role_assignments?user.id=de964adbd34c4ad482354893e9256490&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=a495b5a0c90d469ba925602a6773bed9 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:23.380961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d9a4-4300-4634-a71e-175c1fadc41a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.381306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d9a4-4300-4634-a71e-175c1fadc41a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.381511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d9a4-4300-4634-a71e-175c1fadc41a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.384159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 394/785] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:23.390853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8652ff-bb33-4501-92e6-3e8d4b931a17 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.391143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8652ff-bb33-4501-92e6-3e8d4b931a17 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.391408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8652ff-bb33-4501-92e6-3e8d4b931a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.410176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3c8652ff-bb33-4501-92e6-3e8d4b931a17 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:23.411404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3c8652ff-bb33-4501-92e6-3e8d4b931a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:23.419671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 392/786] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:23 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:23.443814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d9a4-4300-4634-a71e-175c1fadc41a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.457721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d9a4-4300-4634-a71e-175c1fadc41a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.462465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.463278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.463555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.463833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.464508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.466146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.478327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:36:23.479889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 395/787] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:23.487358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8652ff-bb33-4501-92e6-3e8d4b931a17 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.502272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8652ff-bb33-4501-92e6-3e8d4b931a17 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.507867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5f9d4-4cf8-49f1-90c4-e43e74ee4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.508645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5f9d4-4cf8-49f1-90c4-e43e74ee4369 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.509008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5f9d4-4cf8-49f1-90c4-e43e74ee4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.509404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5f9d4-4cf8-49f1-90c4-e43e74ee4369 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.510224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5f9d4-4cf8-49f1-90c4-e43e74ee4369 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:23.510606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5f9d4-4cf8-49f1-90c4-e43e74ee4369 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.512312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5f9d4-4cf8-49f1-90c4-e43e74ee4369 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.518246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 393/788] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:23.524670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.535210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24980-a8c6-4a71-bd65-7bd878b6c754 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.540318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c05f3-a484-419c-be91-3df55f139450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.541310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c05f3-a484-419c-be91-3df55f139450 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.541821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c05f3-a484-419c-be91-3df55f139450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.542274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c05f3-a484-419c-be91-3df55f139450 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.543242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c05f3-a484-419c-be91-3df55f139450 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:23.543740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c05f3-a484-419c-be91-3df55f139450 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.545581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c05f3-a484-419c-be91-3df55f139450 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.551351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 396/789] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:23.755566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c676-51e2-4a93-a655-4957e103b22b None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.755885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c676-51e2-4a93-a655-4957e103b22b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.756137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061c676-51e2-4a93-a655-4957e103b22b None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.758661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 394/790] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:23.765515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbd22f-185b-4952-85ef-3ca9f3471a6f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.765807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbd22f-185b-4952-85ef-3ca9f3471a6f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.766099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbd22f-185b-4952-85ef-3ca9f3471a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.785881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e8dbd22f-185b-4952-85ef-3ca9f3471a6f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:23.786786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e8dbd22f-185b-4952-85ef-3ca9f3471a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:23.796706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 397/791] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:23 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:23.820946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c676-51e2-4a93-a655-4957e103b22b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.834160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061c676-51e2-4a93-a655-4957e103b22b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.838885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.839708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.839995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.840275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.840954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.842575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.855228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:36:23.856924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 395/792] 10.222.0.48 () {56 vars in 1153 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:23.863515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbd22f-185b-4952-85ef-3ca9f3471a6f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.873988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbd22f-185b-4952-85ef-3ca9f3471a6f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.878720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.879404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.879694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.879978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.880718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:23.881028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.882795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.888420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 398/793] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:23.894871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.904985 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2edce-4b45-4e0f-8a32-a52c4f37ac7b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.909753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.910435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.910778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.911061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.911893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:23.912214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.914464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.920487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 396/794] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:23.927085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.938139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ad70-1eed-4aff-b52c-3cd992c47816 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.943083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f6565-da87-4a02-82aa-6dd2a1fb4b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.943842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6565-da87-4a02-82aa-6dd2a1fb4b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.944134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6565-da87-4a02-82aa-6dd2a1fb4b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.944418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f6565-da87-4a02-82aa-6dd2a1fb4b05 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.945338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6565-da87-4a02-82aa-6dd2a1fb4b05 admin admin] RBAC: Adding query filter params (interface=public, service_id=7284c38a461046198b0af5680ed49453, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:23.945692 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6565-da87-4a02-82aa-6dd2a1fb4b05 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.947650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f6565-da87-4a02-82aa-6dd2a1fb4b05 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.954735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 399/795] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/endpoints?service_id=7284c38a461046198b0af5680ed49453&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:23.960713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:23.971234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc04e-db05-4804-b125-b5954abeeb13 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:23.977321 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5d60d-4992-41d8-a925-140608d77ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:23.978311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d60d-4992-41d8-a925-140608d77ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:23.978638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d60d-4992-41d8-a925-140608d77ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:23.978972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5d60d-4992-41d8-a925-140608d77ba3 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:23.979693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5d60d-4992-41d8-a925-140608d77ba3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:23.981487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5d60d-4992-41d8-a925-140608d77ba3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:23.988316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 397/796] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:23 2021] GET /identity/v3/services => generated 1029 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:36:24.110850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd0ce-6469-4591-950d-e013fa1b71b6 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:24.111154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd0ce-6469-4591-950d-e013fa1b71b6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:24.111335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dd0ce-6469-4591-950d-e013fa1b71b6 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:24.113518 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 400/797] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:24.120038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1efe3f-2321-4854-be1b-0b3d33d28d4c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:24.120345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1efe3f-2321-4854-be1b-0b3d33d28d4c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:24.120603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1efe3f-2321-4854-be1b-0b3d33d28d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:24.140310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3a1efe3f-2321-4854-be1b-0b3d33d28d4c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:24.141582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3a1efe3f-2321-4854-be1b-0b3d33d28d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:24.150596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 398/798] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:24 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:24.174854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dd0ce-6469-4591-950d-e013fa1b71b6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:24.188293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dd0ce-6469-4591-950d-e013fa1b71b6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:24.193278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26643129-f4ca-483e-99c9-b34d33b981de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:24.194328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26643129-f4ca-483e-99c9-b34d33b981de admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:24.194863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26643129-f4ca-483e-99c9-b34d33b981de admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:24.195370 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26643129-f4ca-483e-99c9-b34d33b981de admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:24.196367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26643129-f4ca-483e-99c9-b34d33b981de admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:24.198454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26643129-f4ca-483e-99c9-b34d33b981de admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:24.215164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 401/799] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:24 2021] POST /identity/v3/services => generated 251 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:24.955551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063596a-6cee-4301-97b4-eabbe5b3ca64 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:24.956092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063596a-6cee-4301-97b4-eabbe5b3ca64 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:24.956092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063596a-6cee-4301-97b4-eabbe5b3ca64 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:24.958300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 399/800] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:24.964585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497cb52-05a3-452c-8d24-d7b1316904be None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:24.965054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497cb52-05a3-452c-8d24-d7b1316904be None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:24.965240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497cb52-05a3-452c-8d24-d7b1316904be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:24.984791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4497cb52-05a3-452c-8d24-d7b1316904be None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:24.986423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4497cb52-05a3-452c-8d24-d7b1316904be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:25.004716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 402/801] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:24 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:25.029597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063596a-6cee-4301-97b4-eabbe5b3ca64 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.042250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063596a-6cee-4301-97b4-eabbe5b3ca64 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.046728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.047544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.047832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.048110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.059845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:25.067248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:36:25.073483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 400/802] 10.222.0.48 () {56 vars in 1141 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:25.076111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497cb52-05a3-452c-8d24-d7b1316904be None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.085757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497cb52-05a3-452c-8d24-d7b1316904be None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.090707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.091496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.091917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.092272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.093116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:25.093534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.095206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.104667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 403/803] 10.222.0.48 () {56 vars in 1136 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:25.111114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.121945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528838-8fa1-46b1-9e31-58f387bbdc47 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.126919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.127879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.128339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.128763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.141153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.143267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.163217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:25.169530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 401/804] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:25.171863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.182772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfc0ba-ab44-4d65-87a3-e5820ef63be8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.187690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.188557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.189027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.189496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.190417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:25.190879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.192659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.211919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 404/805] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:25.213498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.223750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6570a-82a0-459f-9ac5-d54a3457f82d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.229253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.230332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.230786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.231221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.240569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.243459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.258607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:36:25.260168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 402/806] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:25.267042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.277530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c41746-200b-4277-bd8e-6c41b05edf07 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.282666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.283834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.284353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.284834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.285959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:25.286493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.289299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.314734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 405/807] 10.222.0.48 () {56 vars in 1170 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:25.317495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.328728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52563b-79db-497b-beee-60f198bf319e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.333552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.334400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.334686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.335015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.346721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.348782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.367747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:25.369343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 403/808] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:25.375919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.386185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926ca2-ae1f-4252-972a-4447b71768cf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.391409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.392341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.392848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.393345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.394339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:25.394847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.396662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.417640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 406/809] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:25.420849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.440005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59966e83-ace1-4a7e-a16e-bf08bf637638 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.446345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.448078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.448916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.449632 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.458673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.461223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.479989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:25.485495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 404/810] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:25.488968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.500394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832955d9-e39a-436a-b932-1085ae2caa78 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.505700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625745b2-b656-4320-a04a-c853180ef9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.506870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625745b2-b656-4320-a04a-c853180ef9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.507399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625745b2-b656-4320-a04a-c853180ef9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.507899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625745b2-b656-4320-a04a-c853180ef9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.509004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625745b2-b656-4320-a04a-c853180ef9cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:25.509572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625745b2-b656-4320-a04a-c853180ef9cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.511698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625745b2-b656-4320-a04a-c853180ef9cf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.529483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 407/811] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:25.533083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:25.544413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ced08-2490-4c39-a2b8-658b16fe2fe3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:25.550218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef0424-97c7-4515-9c44-232bf053baf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:25.551175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef0424-97c7-4515-9c44-232bf053baf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.551609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef0424-97c7-4515-9c44-232bf053baf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.551910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef0424-97c7-4515-9c44-232bf053baf1 admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/de964adbd34c4ad482354893e9256490/roles/a495b5a0c90d469ba925602a6773bed9` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.555448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef0424-97c7-4515-9c44-232bf053baf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=de964adbd34c4ad482354893e9256490, role_id=a495b5a0c90d469ba925602a6773bed9)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:25.559254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef0424-97c7-4515-9c44-232bf053baf1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:25.576502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 405/812] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:25 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/de964adbd34c4ad482354893e9256490/roles/a495b5a0c90d469ba925602a6773bed9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:25.981079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d4c40-9f64-4a74-ac9f-3beffbb64f5c None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.981641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d4c40-9f64-4a74-ac9f-3beffbb64f5c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.981718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d4c40-9f64-4a74-ac9f-3beffbb64f5c None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:25.984078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 408/813] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:25.990559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05f8f-b403-4628-bdce-124a7fad3b1c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:25.991053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05f8f-b403-4628-bdce-124a7fad3b1c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:25.991129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05f8f-b403-4628-bdce-124a7fad3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.009864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e1b05f8f-b403-4628-bdce-124a7fad3b1c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:26.011068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e1b05f8f-b403-4628-bdce-124a7fad3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:26.075924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 406/814] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:25 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:26.100700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d4c40-9f64-4a74-ac9f-3beffbb64f5c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.117989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d4c40-9f64-4a74-ac9f-3beffbb64f5c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.122890 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ee727-40cf-4fff-87c3-aeccf9635bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.123556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee727-40cf-4fff-87c3-aeccf9635bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.123847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee727-40cf-4fff-87c3-aeccf9635bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.124128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee727-40cf-4fff-87c3-aeccf9635bdb admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.124885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ee727-40cf-4fff-87c3-aeccf9635bdb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.126625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ee727-40cf-4fff-87c3-aeccf9635bdb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.142525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 409/815] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:26 2021] POST /identity/v3/services => generated 241 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:26.456463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5f0c-8e56-4411-9152-28f5a1d901da None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.457040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5f0c-8e56-4411-9152-28f5a1d901da None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.457508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5f0c-8e56-4411-9152-28f5a1d901da None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.459516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 407/816] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:26.466953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20778a-ed6a-4ab1-9d3b-bbb810c05af4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.467569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20778a-ed6a-4ab1-9d3b-bbb810c05af4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.468053 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20778a-ed6a-4ab1-9d3b-bbb810c05af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.487256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7b20778a-ed6a-4ab1-9d3b-bbb810c05af4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:26.488864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7b20778a-ed6a-4ab1-9d3b-bbb810c05af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:26.510580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 410/817] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:26 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:26.531341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5f0c-8e56-4411-9152-28f5a1d901da None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.544851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5f0c-8e56-4411-9152-28f5a1d901da None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.549692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.550736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.551251 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.551724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.552594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.554459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.566979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 16:36:26.573555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 408/818] 10.222.0.48 () {56 vars in 1153 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:26.576822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20778a-ed6a-4ab1-9d3b-bbb810c05af4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.587637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20778a-ed6a-4ab1-9d3b-bbb810c05af4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.592934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.594006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.594522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.595008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.595960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:26.596480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.598380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.608853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 411/819] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:26.612502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.622956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f45eb-f826-43ca-b8c6-b91b2ad0ec27 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.628050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884772f-35ba-48a8-b647-9ce17be8cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.629035 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884772f-35ba-48a8-b647-9ce17be8cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.629573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884772f-35ba-48a8-b647-9ce17be8cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.630194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884772f-35ba-48a8-b647-9ce17be8cc72 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.631850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884772f-35ba-48a8-b647-9ce17be8cc72 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:26.632830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884772f-35ba-48a8-b647-9ce17be8cc72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.636160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884772f-35ba-48a8-b647-9ce17be8cc72 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.642657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 409/820] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:26.650079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.660555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0985bf-fbda-4f36-a939-5e9127375c40 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.666205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dd3e0-b94b-452a-aa58-e25fce5c6505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.667184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dd3e0-b94b-452a-aa58-e25fce5c6505 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.667701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dd3e0-b94b-452a-aa58-e25fce5c6505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.668201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dd3e0-b94b-452a-aa58-e25fce5c6505 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.669265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dd3e0-b94b-452a-aa58-e25fce5c6505 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.671178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dd3e0-b94b-452a-aa58-e25fce5c6505 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.697579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 412/821] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:26 2021] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:26.734309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8f34-ca4f-4c65-9e5b-781941b21b1c None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.734600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8f34-ca4f-4c65-9e5b-781941b21b1c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.734798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad8f34-ca4f-4c65-9e5b-781941b21b1c None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.736957 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 410/822] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:26.743553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732b44-a9c3-4b75-a621-aeef504636b3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.743864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732b44-a9c3-4b75-a621-aeef504636b3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.744131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732b44-a9c3-4b75-a621-aeef504636b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.764175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-37732b44-a9c3-4b75-a621-aeef504636b3 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:26.765460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-37732b44-a9c3-4b75-a621-aeef504636b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:26.785581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 413/823] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:26 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:26.814429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8f34-ca4f-4c65-9e5b-781941b21b1c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.828729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad8f34-ca4f-4c65-9e5b-781941b21b1c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.833827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.834921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.835982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.836510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.837407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.839260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.851977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:36:26.854624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 411/824] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:26.862478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732b44-a9c3-4b75-a621-aeef504636b3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.872723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732b44-a9c3-4b75-a621-aeef504636b3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.878442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.879562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.880059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.880617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.881645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:26.882792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.884816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.891667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 414/825] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:26.899737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.911316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b008-d316-4530-a7c7-fb285635f818 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.917062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.918452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.919045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.919554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.920560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:26.921112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.923953 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.933178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 412/826] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:26.942386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.955425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be663f7-8271-4519-b535-dea1364f97aa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:26.962700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463496ca-1716-439a-9ac8-89e8bc3b4877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:26.963927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463496ca-1716-439a-9ac8-89e8bc3b4877 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:26.964358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463496ca-1716-439a-9ac8-89e8bc3b4877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:26.964767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463496ca-1716-439a-9ac8-89e8bc3b4877 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:26.965976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463496ca-1716-439a-9ac8-89e8bc3b4877 admin admin] RBAC: Adding query filter params (interface=public, service_id=e72ea7f86be14a0db43e25ce8cdd7438, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:26.966399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463496ca-1716-439a-9ac8-89e8bc3b4877 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:26.968729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463496ca-1716-439a-9ac8-89e8bc3b4877 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:26.976879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 415/827] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/endpoints?service_id=e72ea7f86be14a0db43e25ce8cdd7438&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:26.983213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:26.996781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e3d39-303b-4ce9-b3e0-24e120cde15d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:27.007750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3d84-738e-4ac3-b493-52c29b0d4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:27.008431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3d84-738e-4ac3-b493-52c29b0d4018 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:27.008713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3d84-738e-4ac3-b493-52c29b0d4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:27.009052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3d84-738e-4ac3-b493-52c29b0d4018 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:27.010341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3d84-738e-4ac3-b493-52c29b0d4018 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:27.011438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3d84-738e-4ac3-b493-52c29b0d4018 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:27.021842 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 413/828] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:26 2021] GET /identity/v3/services => generated 1497 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:36:28.006193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c881d-0557-4f78-8ea9-54d7c95b8919 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.006567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c881d-0557-4f78-8ea9-54d7c95b8919 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.006786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c881d-0557-4f78-8ea9-54d7c95b8919 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.008887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 416/829] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:28.015343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07b0c-1118-4317-974d-e81ca707e5e9 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.015807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07b0c-1118-4317-974d-e81ca707e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.016084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07b0c-1118-4317-974d-e81ca707e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.034483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8bf07b0c-1118-4317-974d-e81ca707e5e9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:28.035678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8bf07b0c-1118-4317-974d-e81ca707e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:28.049486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 414/830] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:28 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:28.069085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c881d-0557-4f78-8ea9-54d7c95b8919 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.082847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c881d-0557-4f78-8ea9-54d7c95b8919 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.088421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.089237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.089554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.089836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.101854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:28.109558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:36:28.115802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 417/831] 10.222.0.48 () {56 vars in 1141 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:28.118091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf07b0c-1118-4317-974d-e81ca707e5e9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.127605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf07b0c-1118-4317-974d-e81ca707e5e9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.132505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.133189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.133502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.133780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.134555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.134863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.136470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.149487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 415/832] 10.222.0.48 () {56 vars in 1136 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.152847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.163972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690d1ee-e3ea-481a-bcac-5fedfb9d4544 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.168671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.169480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.169765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.170044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.181279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.183181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.201606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:28.208736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 418/833] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:28.210343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.223740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdb0b2-409c-400c-bb83-15ad35c367af admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.231760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.232825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.233293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.233813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.235089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.235648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.238488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.261505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 416/834] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.270738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.281235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269aa0-6dbf-43f2-a7a0-9ac2f0f2bf53 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.286018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.286829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.287115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.287391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.295938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.298004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.313758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 16:36:28.320001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 419/835] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:28.322220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.335390 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713e1ca-1900-4e64-8eb7-8b7c2d037db8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.340130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.340804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.341089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.341365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.342290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.342602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.344457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.363626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 417/836] 10.222.0.48 () {56 vars in 1170 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.375212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.386101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fb911-b6d8-4ce6-b885-09002052c703 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.391522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.392404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.392854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.393321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.402468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.404633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.420337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 420/837] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:28.424254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.436253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda414fb-9f96-4aa0-a1a9-4038eb1a3930 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.441721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.443015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.443491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.443947 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.458206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.462098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.483162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:28.489479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 418/838] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:28.492357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.502119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a49f6-15ac-4130-ba31-08d9df292bed admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.507084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bb3cd-8928-4090-abef-a54f3156eb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.507977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bb3cd-8928-4090-abef-a54f3156eb4b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.508459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bb3cd-8928-4090-abef-a54f3156eb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.508963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bb3cd-8928-4090-abef-a54f3156eb4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.510082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bb3cd-8928-4090-abef-a54f3156eb4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.510614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bb3cd-8928-4090-abef-a54f3156eb4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.512451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bb3cd-8928-4090-abef-a54f3156eb4b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.530910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 421/839] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.532527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.547189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809806-1b56-43d7-b687-b6e37f5bba1d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.552195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.553218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.553749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.554899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.562992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.565647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.565762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114edad-bc37-4f57-85e8-87ec4468cd09 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.566031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114edad-bc37-4f57-85e8-87ec4468cd09 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.566314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114edad-bc37-4f57-85e8-87ec4468cd09 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.568343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 422/840] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:28.574522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d9194-aee6-460e-b250-5f73b9961992 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.574809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d9194-aee6-460e-b250-5f73b9961992 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.575098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d9194-aee6-460e-b250-5f73b9961992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.583996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:28.590818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 419/841] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:28.594265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.596014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4d5d9194-aee6-460e-b250-5f73b9961992 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:28.597286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4d5d9194-aee6-460e-b250-5f73b9961992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:28.607450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003cef9-ff03-4cc4-b1b3-bd9842da477f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.609942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 423/842] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:28 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:28.619451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.620559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.621018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.621498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.623014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.623555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.627133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.637091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d9194-aee6-460e-b250-5f73b9961992 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.641468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 420/843] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.648451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.651058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d9194-aee6-460e-b250-5f73b9961992 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.657836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.658957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.659434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.659751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af887498-28e1-4723-8787-cda3679b7f48 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.660133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.660998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.662824 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.665248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.665983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.666270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.666549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.667516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] RBAC: Adding query filter params (role.id=a495b5a0c90d469ba925602a6773bed9, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=de964adbd34c4ad482354893e9256490) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.667805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.669755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.678487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:36:28.685416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 424/845] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:28.685610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 421/845] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/role_assignments?user.id=de964adbd34c4ad482354893e9256490&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=a495b5a0c90d469ba925602a6773bed9 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:28.687780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.698900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815f30-0075-4bf5-8ca5-f39d8048eaf3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.704453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.705591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.706080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.706581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.707968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.708546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.710997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.717221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 422/846] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.724396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.735770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db9d29-b2b8-402c-b163-e0ee727e9332 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.741319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.742444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.742929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.743431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.744402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.744926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.746849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.752911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 425/847] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.760397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.771394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ec44-5cf7-4b35-b3b2-b52a11289a8f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.777303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ce42e-d4a3-4d2a-a903-f79105e3f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.778332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ce42e-d4a3-4d2a-a903-f79105e3f6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.778813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ce42e-d4a3-4d2a-a903-f79105e3f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.779331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ce42e-d4a3-4d2a-a903-f79105e3f6d1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.780350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ce42e-d4a3-4d2a-a903-f79105e3f6d1 admin admin] RBAC: Adding query filter params (interface=public, service_id=c42fa49f493c4c7ab051d19841cf8152, region_id=RegionOne) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:28.780899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ce42e-d4a3-4d2a-a903-f79105e3f6d1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.782766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ce42e-d4a3-4d2a-a903-f79105e3f6d1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.789824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 423/848] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/endpoints?service_id=c42fa49f493c4c7ab051d19841cf8152&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:28.796733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:28.807457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0d835-22ff-4c85-8c91-6cc4ce4d3d09 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:28.813121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f38269-4f04-4226-99c0-8cd87125ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:28.814219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38269-4f04-4226-99c0-8cd87125ff0f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:28.814718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38269-4f04-4226-99c0-8cd87125ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:28.815239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f38269-4f04-4226-99c0-8cd87125ff0f admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:28.816163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f38269-4f04-4226-99c0-8cd87125ff0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:28.818073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f38269-4f04-4226-99c0-8cd87125ff0f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:28.829859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 426/849] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:28 2021] GET /identity/v3/services => generated 1497 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:36:29.385277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76323b-4bd4-4f26-92f2-0cf3990ef0fe None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.386287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76323b-4bd4-4f26-92f2-0cf3990ef0fe None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.386771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76323b-4bd4-4f26-92f2-0cf3990ef0fe None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.388754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 424/850] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:29.394953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f738609-fcf6-40e1-aed2-bb374a389125 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.395363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f738609-fcf6-40e1-aed2-bb374a389125 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.395572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f738609-fcf6-40e1-aed2-bb374a389125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.414477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2f738609-fcf6-40e1-aed2-bb374a389125 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:29.415779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2f738609-fcf6-40e1-aed2-bb374a389125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:29.424826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 427/851] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:29 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:29.450877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76323b-4bd4-4f26-92f2-0cf3990ef0fe None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:29.463999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76323b-4bd4-4f26-92f2-0cf3990ef0fe None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:29.468548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:29.469353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.469656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.469932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.470606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:29.472201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:29.484133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:36:29.489743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 425/852] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:29 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:29.492888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f738609-fcf6-40e1-aed2-bb374a389125 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:29.502117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f738609-fcf6-40e1-aed2-bb374a389125 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:29.507054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac27c-acd9-4a17-b5cb-ae0ef20cb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:29.508284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac27c-acd9-4a17-b5cb-ae0ef20cb562 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.508567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac27c-acd9-4a17-b5cb-ae0ef20cb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.508911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac27c-acd9-4a17-b5cb-ae0ef20cb562 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.510039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac27c-acd9-4a17-b5cb-ae0ef20cb562 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:29.510453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac27c-acd9-4a17-b5cb-ae0ef20cb562 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:29.512102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac27c-acd9-4a17-b5cb-ae0ef20cb562 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:29.517329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 428/853] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:29.523912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:29.534371 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bfbec-e573-467a-a64a-aa1a5e86048e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:29.539080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e9241-c94f-4245-b2c0-f8a04d3c1dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:29.539737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e9241-c94f-4245-b2c0-f8a04d3c1dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.540019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e9241-c94f-4245-b2c0-f8a04d3c1dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.540294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e9241-c94f-4245-b2c0-f8a04d3c1dfa admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.541057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e9241-c94f-4245-b2c0-f8a04d3c1dfa admin admin] RBAC: Adding query filter params (type=compute) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:29.541366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e9241-c94f-4245-b2c0-f8a04d3c1dfa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:29.543011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e9241-c94f-4245-b2c0-f8a04d3c1dfa admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:29.548570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 426/854] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:29 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:29.585490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815d4a-46b0-45e1-a74b-f6f805bb6025 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.585831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815d4a-46b0-45e1-a74b-f6f805bb6025 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.586056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815d4a-46b0-45e1-a74b-f6f805bb6025 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.587922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 429/855] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:29.594668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95aaf1-7f77-4207-be21-c53eee84f83d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.594973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95aaf1-7f77-4207-be21-c53eee84f83d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.595231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95aaf1-7f77-4207-be21-c53eee84f83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.619120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9c95aaf1-7f77-4207-be21-c53eee84f83d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:29.620754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9c95aaf1-7f77-4207-be21-c53eee84f83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:29.633510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 427/856] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:29 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:29.655961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815d4a-46b0-45e1-a74b-f6f805bb6025 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:29.669174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815d4a-46b0-45e1-a74b-f6f805bb6025 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:29.674358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:29.675785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.676296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.676816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.677784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:29.680460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:29.693275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 16:36:29.695884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 430/857] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:29 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:29.702411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95aaf1-7f77-4207-be21-c53eee84f83d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:29.712164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95aaf1-7f77-4207-be21-c53eee84f83d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:29.717399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:29.718103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.718440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.718723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.719476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:29.719788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:29.721497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:29.727971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 428/858] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:29 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:29.734997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:29.746051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1aceb-73de-4c77-aea5-f45a8023ee43 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:29.751156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0297e9-eab2-4c9f-95c2-ac890754b018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:29.751990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0297e9-eab2-4c9f-95c2-ac890754b018 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.752379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0297e9-eab2-4c9f-95c2-ac890754b018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.752758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0297e9-eab2-4c9f-95c2-ac890754b018 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.753643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0297e9-eab2-4c9f-95c2-ac890754b018 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:29.754080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0297e9-eab2-4c9f-95c2-ac890754b018 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:29.755802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0297e9-eab2-4c9f-95c2-ac890754b018 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:29.761918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 431/859] 10.222.0.48 () {56 vars in 1135 bytes} [Tue Oct 12 16:36:29 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:29.768337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:29.782664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125dd42-afe2-4e01-9724-8cdbbb282e2c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:29.789606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b383aed-4824-4d33-9ad6-efbed3a843f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:29.790283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b383aed-4824-4d33-9ad6-efbed3a843f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:29.790566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b383aed-4824-4d33-9ad6-efbed3a843f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:29.790842 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b383aed-4824-4d33-9ad6-efbed3a843f1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:29.791655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b383aed-4824-4d33-9ad6-efbed3a843f1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:29.793240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b383aed-4824-4d33-9ad6-efbed3a843f1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:29.814830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 429/860] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:29 2021] POST /identity/v3/endpoints => generated 346 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:31.266501 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd669e-54e7-4a10-836c-9db6475dd414 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.267148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd669e-54e7-4a10-836c-9db6475dd414 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.267148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd669e-54e7-4a10-836c-9db6475dd414 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.269149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 432/861] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:31.273296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabc2e-f7af-4c56-a235-865117ea40c2 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.275334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabc2e-f7af-4c56-a235-865117ea40c2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.275909 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3a76-b102-45f7-a9a2-0db6c35f671e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.276196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3a76-b102-45f7-a9a2-0db6c35f671e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.276477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3a76-b102-45f7-a9a2-0db6c35f671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.276927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eabc2e-f7af-4c56-a235-865117ea40c2 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.282711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 430/862] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:31 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:31.290230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21d46-c332-4665-8174-e644e62ff1bd None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.291027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21d46-c332-4665-8174-e644e62ff1bd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.291793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e21d46-c332-4665-8174-e644e62ff1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.296935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-756b3a76-b102-45f7-a9a2-0db6c35f671e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:31.298189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-756b3a76-b102-45f7-a9a2-0db6c35f671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:31.315047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e3e21d46-c332-4665-8174-e644e62ff1bd None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:31.316962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 433/863] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:31 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:31.317282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e3e21d46-c332-4665-8174-e644e62ff1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:31.333547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 431/864] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:31 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:31.341892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3a76-b102-45f7-a9a2-0db6c35f671e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:31.351477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3a76-b102-45f7-a9a2-0db6c35f671e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:31.353648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e21d46-c332-4665-8174-e644e62ff1bd None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:31.356401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:31.357196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.357514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.357768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.358439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:31.360024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:31.365816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e21d46-c332-4665-8174-e644e62ff1bd None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:31.371386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:31.372194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.372475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.372752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] PATH_INFO: `/v3/services/image` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.373446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:31.375162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:31.376892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:36:31.378732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 434/865] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:31 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:31.385670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:31.387770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:36:31.389403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 432/866] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 12 16:36:31 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:31.396366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:31.401783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a71d8-4441-4e4c-ba92-8c18242880e2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:31.407659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:31.408320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.408604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.408881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.409645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:31.409952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:31.410482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d66cb-67d2-433a-8d7d-24d6fb0ae4eb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:31.411533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:31.417284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:31.418386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.418876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.419351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.420294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] RBAC: Adding query filter params (name=image) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:31.420865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:31.422843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 435/867] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:31 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:31.423293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:31.423745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:31.434983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 433/868] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:31 2021] GET /identity/v3/services?name=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:31.437323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:31.441202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6ce94-8705-4835-9fee-1ed45eeb213d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:31.449903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:31.450878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.451376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878dc1d-2a81-4f0d-a8a6-bafa32eda303 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:31.451594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.452176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.453568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:31.454208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:31.456364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd449a97-045a-42d3-913d-bcb7f86548ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:31.456625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:31.457012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449a97-045a-42d3-913d-bcb7f86548ba admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.457292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449a97-045a-42d3-913d-bcb7f86548ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.457598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd449a97-045a-42d3-913d-bcb7f86548ba admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.458307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd449a97-045a-42d3-913d-bcb7f86548ba admin admin] RBAC: Adding query filter params (type=image) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:31.458612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd449a97-045a-42d3-913d-bcb7f86548ba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:31.460360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd449a97-045a-42d3-913d-bcb7f86548ba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:31.464439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 436/869] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:31 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:31.474459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 434/870] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:31 2021] GET /identity/v3/services?type=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:31.477026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:31.488517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302bc61-9c00-4485-a9c4-c17e83f50c21 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:31.501773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac09ceb-1c67-4aea-8c3f-7d555e633309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:31.502697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09ceb-1c67-4aea-8c3f-7d555e633309 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:31.503354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09ceb-1c67-4aea-8c3f-7d555e633309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:31.503808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09ceb-1c67-4aea-8c3f-7d555e633309 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:31.504750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac09ceb-1c67-4aea-8c3f-7d555e633309 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:31.506796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac09ceb-1c67-4aea-8c3f-7d555e633309 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:31.531899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 437/871] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:31 2021] POST /identity/v3/endpoints => generated 349 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:32.127332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159185-33e5-4150-a4e3-2ad590295beb None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.127655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159185-33e5-4150-a4e3-2ad590295beb None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.127892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159185-33e5-4150-a4e3-2ad590295beb None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.129945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 435/872] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:32.137154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130879c-8e1e-4541-8062-3cea0f0ebf3c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.137708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130879c-8e1e-4541-8062-3cea0f0ebf3c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.138037 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130879c-8e1e-4541-8062-3cea0f0ebf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.156511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a130879c-8e1e-4541-8062-3cea0f0ebf3c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:32.158086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a130879c-8e1e-4541-8062-3cea0f0ebf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:32.177504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 438/873] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:32 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:32.205663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3159185-33e5-4150-a4e3-2ad590295beb None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:32.219774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3159185-33e5-4150-a4e3-2ad590295beb None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:32.224872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755155b-c6d7-4574-8e2d-bcec54e04638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:32.225704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755155b-c6d7-4574-8e2d-bcec54e04638 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.226035 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755155b-c6d7-4574-8e2d-bcec54e04638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.226306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755155b-c6d7-4574-8e2d-bcec54e04638 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.227071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755155b-c6d7-4574-8e2d-bcec54e04638 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:32.228655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755155b-c6d7-4574-8e2d-bcec54e04638 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:32.245864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 436/874] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:32 2021] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:32.359840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff074fe2-b216-4425-bdb7-367a8f29a379 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.360343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff074fe2-b216-4425-bdb7-367a8f29a379 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.360343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff074fe2-b216-4425-bdb7-367a8f29a379 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.362849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 439/875] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:32.371187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40718-d3c0-4ac6-908d-4e9dff05a38a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.371693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40718-d3c0-4ac6-908d-4e9dff05a38a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.372110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40718-d3c0-4ac6-908d-4e9dff05a38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.402323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1db40718-d3c0-4ac6-908d-4e9dff05a38a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:32.403537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1db40718-d3c0-4ac6-908d-4e9dff05a38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:32.424638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 437/876] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:32 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:32.451301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff074fe2-b216-4425-bdb7-367a8f29a379 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:32.467869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff074fe2-b216-4425-bdb7-367a8f29a379 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:32.472579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:32.473250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.473581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.473860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.474735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:32.476657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:32.478084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.common [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 16:36:32.498608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.sql.core [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 16:36:32.498608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 16:36:32.498608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [parameters: {'id': '82c88bcaa31c4249aac758c3ec536bef', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 16:36:32.498608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80072) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:36:32.515228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 82c88bcaa31c4249aac758c3ec536bef.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 82c88bcaa31c4249aac758c3ec536bef. Oct 12 16:36:32.517260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 440/877] 10.222.0.48 () {60 vars in 1161 bytes} [Tue Oct 12 16:36:32 2021] POST /identity/v3/projects => generated 262 bytes in 67 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:32.525595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40718-d3c0-4ac6-908d-4e9dff05a38a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:32.535006 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40718-d3c0-4ac6-908d-4e9dff05a38a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:32.539727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dc1f1-5b71-4e93-9cd1-3faac40329ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:32.540513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dc1f1-5b71-4e93-9cd1-3faac40329ec admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.540908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dc1f1-5b71-4e93-9cd1-3faac40329ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.541353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dc1f1-5b71-4e93-9cd1-3faac40329ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.550591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dc1f1-5b71-4e93-9cd1-3faac40329ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:32.553797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dc1f1-5b71-4e93-9cd1-3faac40329ec admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:32.568307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-db8dc1f1-5b71-4e93-9cd1-3faac40329ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:32.570406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 438/878] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:32.579102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:32.593590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803461d-40f6-460d-94db-7e6eabae4420 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:32.598900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7ddb-5ecd-4c9c-a5fb-5f77bd2c15fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:32.599562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7ddb-5ecd-4c9c-a5fb-5f77bd2c15fa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:32.599842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7ddb-5ecd-4c9c-a5fb-5f77bd2c15fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:32.600120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7ddb-5ecd-4c9c-a5fb-5f77bd2c15fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:32.600892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7ddb-5ecd-4c9c-a5fb-5f77bd2c15fa admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:32.601228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7ddb-5ecd-4c9c-a5fb-5f77bd2c15fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:32.603402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7ddb-5ecd-4c9c-a5fb-5f77bd2c15fa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:32.625283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 441/879] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:32 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:33.980464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea8b6-e018-481e-91eb-0d445425aae2 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:33.981120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea8b6-e018-481e-91eb-0d445425aae2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:33.981120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ea8b6-e018-481e-91eb-0d445425aae2 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:33.983130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 439/880] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:33.989722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250f2da-747b-4179-9e31-4688fb3814d8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:33.990139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250f2da-747b-4179-9e31-4688fb3814d8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:33.990301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250f2da-747b-4179-9e31-4688fb3814d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.012743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f250f2da-747b-4179-9e31-4688fb3814d8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:34.014360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f250f2da-747b-4179-9e31-4688fb3814d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:34.029493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 442/881] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:33 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:34.048030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ea8b6-e018-481e-91eb-0d445425aae2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:34.061999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ea8b6-e018-481e-91eb-0d445425aae2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:34.066593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac8e86-eea4-402d-9182-7a0afca546e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:34.067270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8e86-eea4-402d-9182-7a0afca546e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.067557 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8e86-eea4-402d-9182-7a0afca546e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.067841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac8e86-eea4-402d-9182-7a0afca546e2 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.068594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8e86-eea4-402d-9182-7a0afca546e2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:34.070821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac8e86-eea4-402d-9182-7a0afca546e2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:34.093540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 440/882] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:34 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:34.108528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b137-dcab-4fad-b2af-09684c08c45e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.108870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b137-dcab-4fad-b2af-09684c08c45e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.109098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b137-dcab-4fad-b2af-09684c08c45e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.111333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 443/883] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:34.118923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5ac2-e431-4844-b7da-844f71e7a975 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.119233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5ac2-e431-4844-b7da-844f71e7a975 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.119557 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d5ac2-e431-4844-b7da-844f71e7a975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.143864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d00d5ac2-e431-4844-b7da-844f71e7a975 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:34.145608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d00d5ac2-e431-4844-b7da-844f71e7a975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:34.171680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 441/884] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:34 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:34.197416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b137-dcab-4fad-b2af-09684c08c45e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:34.211211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b137-dcab-4fad-b2af-09684c08c45e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:34.216448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:34.217751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.218257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.218779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.219688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:34.221599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:34.235422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:36:34.237342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 444/885] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:34 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:34.245288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d5ac2-e431-4844-b7da-844f71e7a975 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:34.255347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d5ac2-e431-4844-b7da-844f71e7a975 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:34.261164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:34.262266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.262812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.263291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.264270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:34.264796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:34.266669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:34.272856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 442/886] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:34 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:34.280354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:34.295557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a94630-6c3d-4cfc-8c9e-eefe8311ef24 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:34.301618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:34.302651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.303162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.303800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.305390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:34.305916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:34.307895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:34.315090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 445/887] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:34 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:34.323080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:34.334850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576e4f-6d19-4ccc-822e-f19982843786 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:34.340699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea9bda-7593-4665-ba32-0ac14dfb4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:34.341697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea9bda-7593-4665-ba32-0ac14dfb4397 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.342187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea9bda-7593-4665-ba32-0ac14dfb4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.342835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea9bda-7593-4665-ba32-0ac14dfb4397 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.343863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea9bda-7593-4665-ba32-0ac14dfb4397 admin admin] RBAC: Adding query filter params (interface=admin, service_id=c42fa49f493c4c7ab051d19841cf8152, region_id=RegionOne) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:34.344376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea9bda-7593-4665-ba32-0ac14dfb4397 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:34.346194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea9bda-7593-4665-ba32-0ac14dfb4397 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:34.352093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 443/888] 10.222.0.48 () {56 vars in 1270 bytes} [Tue Oct 12 16:36:34 2021] GET /identity/v3/endpoints?service_id=c42fa49f493c4c7ab051d19841cf8152&interface=admin®ion_id=RegionOne => generated 193 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:34.362132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:34.378528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec2e4f-9315-4941-b0e5-e22652a70294 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:34.384352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e240dcc-2140-434f-9084-52f333475d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:34.385224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e240dcc-2140-434f-9084-52f333475d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.385684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e240dcc-2140-434f-9084-52f333475d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.386178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e240dcc-2140-434f-9084-52f333475d5d admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.387031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e240dcc-2140-434f-9084-52f333475d5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:34.389113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e240dcc-2140-434f-9084-52f333475d5d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:34.398728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 446/889] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:34 2021] GET /identity/v3/services => generated 1957 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:36:34.869270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9970-86bc-46e3-8147-f41bd17a9974 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.869800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9970-86bc-46e3-8147-f41bd17a9974 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.870252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9970-86bc-46e3-8147-f41bd17a9974 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.873136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 444/890] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:34.879970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fccb0-3366-49c0-9308-0dad1504413d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.880311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fccb0-3366-49c0-9308-0dad1504413d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.880635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fccb0-3366-49c0-9308-0dad1504413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.901111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a10fccb0-3366-49c0-9308-0dad1504413d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:34.902798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a10fccb0-3366-49c0-9308-0dad1504413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:34.912174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 447/891] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:34 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:34.941225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9970-86bc-46e3-8147-f41bd17a9974 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:34.954283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9970-86bc-46e3-8147-f41bd17a9974 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:34.958745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:34.959524 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:34.959803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:34.960076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:34.961299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:34.963879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:34.984212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:36:34.985796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 445/892] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:34 2021] GET /identity/v3/services/compute => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:34.992734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fccb0-3366-49c0-9308-0dad1504413d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:35.004363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fccb0-3366-49c0-9308-0dad1504413d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:35.009599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:35.010277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.010564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.010840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.011573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:35.011880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:35.013593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:35.019628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 448/893] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:34 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:35.027476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:35.039936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35b761-d6e7-45e6-82ff-7dfc8fa9e777 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:35.045585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:35.046337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.046617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.046896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.047637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:35.047956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:35.049919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:35.056672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 446/894] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:35 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:35.063460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:35.073885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb39128-f8a3-4394-9559-b3c0e37e1051 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:35.082768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776855c-a14d-4587-b80f-6271ee382560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:35.083438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776855c-a14d-4587-b80f-6271ee382560 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.083729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776855c-a14d-4587-b80f-6271ee382560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.084057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776855c-a14d-4587-b80f-6271ee382560 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.084998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776855c-a14d-4587-b80f-6271ee382560 admin admin] RBAC: Adding query filter params (interface=public, service_id=b408d00ce67240e19b7e555f72c6ed78, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:35.085386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776855c-a14d-4587-b80f-6271ee382560 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:35.087630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776855c-a14d-4587-b80f-6271ee382560 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:35.093883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 449/895] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:36:35 2021] GET /identity/v3/endpoints?service_id=b408d00ce67240e19b7e555f72c6ed78&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:35.103690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:35.116030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97b770-dad8-4f7e-b0fb-a15b520f4aa5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:35.121330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9f5e-d881-48b1-89a4-40213f99f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:35.121964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9f5e-d881-48b1-89a4-40213f99f041 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.122250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9f5e-d881-48b1-89a4-40213f99f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.122525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9f5e-d881-48b1-89a4-40213f99f041 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.123218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9f5e-d881-48b1-89a4-40213f99f041 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:35.124932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9f5e-d881-48b1-89a4-40213f99f041 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:35.133034 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 447/896] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:35 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:36:35.185505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2763218-062b-4b25-947e-388fb7a3e34b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.185821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2763218-062b-4b25-947e-388fb7a3e34b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.186063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2763218-062b-4b25-947e-388fb7a3e34b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.187914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 450/897] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:35.197020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461d8f-bfb6-4d25-a5c3-18131dcca45e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.197349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461d8f-bfb6-4d25-a5c3-18131dcca45e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.197633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45461d8f-bfb6-4d25-a5c3-18131dcca45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.219440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-45461d8f-bfb6-4d25-a5c3-18131dcca45e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:35.220695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-45461d8f-bfb6-4d25-a5c3-18131dcca45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:35.233544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 448/898] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:35 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:35.260989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2763218-062b-4b25-947e-388fb7a3e34b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:35.276509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2763218-062b-4b25-947e-388fb7a3e34b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:35.282557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:35.283614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.283980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.284267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.285098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:35.287191 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:35.305225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.sql.core [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 16:36:35.305225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 16:36:35.305225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [parameters: {'user_id': '918201fe192f4e2c8030f1c0ec66a441', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 16:36:35.305225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80072) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 16:36:35.311706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 16:36:35.313553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 451/899] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:36:35 2021] POST /identity/v3/users => generated 160 bytes in 53 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:35.325722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461d8f-bfb6-4d25-a5c3-18131dcca45e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:35.338288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45461d8f-bfb6-4d25-a5c3-18131dcca45e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:35.344179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cbcf5-cb4d-4615-8de5-2c6e64d15f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:35.345009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cbcf5-cb4d-4615-8de5-2c6e64d15f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.345298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cbcf5-cb4d-4615-8de5-2c6e64d15f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.345605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cbcf5-cb4d-4615-8de5-2c6e64d15f80 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.354618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cbcf5-cb4d-4615-8de5-2c6e64d15f80 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:35.356670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cbcf5-cb4d-4615-8de5-2c6e64d15f80 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:35.374773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fd0cbcf5-cb4d-4615-8de5-2c6e64d15f80 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 16:36:35.376351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 449/900] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:35 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:35.383768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:35.396972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eec3b0-e26e-42b1-b2db-47085a5a3b77 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:35.402611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7dbf7-3634-4918-be57-e09a6406f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:35.403471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7dbf7-3634-4918-be57-e09a6406f490 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:35.403817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7dbf7-3634-4918-be57-e09a6406f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:35.404102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7dbf7-3634-4918-be57-e09a6406f490 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:35.404995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7dbf7-3634-4918-be57-e09a6406f490 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:35.405311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7dbf7-3634-4918-be57-e09a6406f490 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:35.407601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7dbf7-3634-4918-be57-e09a6406f490 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:35.450978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 452/901] 10.222.0.48 () {56 vars in 1122 bytes} [Tue Oct 12 16:36:35 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:36.680619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d87e-682c-4239-ab6e-d6d46f5e314a None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.681824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d87e-682c-4239-ab6e-d6d46f5e314a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.682106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001d87e-682c-4239-ab6e-d6d46f5e314a None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.684481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 450/902] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:36.691678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda466d-6b0d-4c00-b77c-ff4ce2cb201a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.692672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda466d-6b0d-4c00-b77c-ff4ce2cb201a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.693182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda466d-6b0d-4c00-b77c-ff4ce2cb201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.716034 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5bda466d-6b0d-4c00-b77c-ff4ce2cb201a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:36.717973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5bda466d-6b0d-4c00-b77c-ff4ce2cb201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:36.726799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 453/903] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:36 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:36.752155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d87e-682c-4239-ab6e-d6d46f5e314a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.770387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001d87e-682c-4239-ab6e-d6d46f5e314a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.775917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502636-9e8e-4feb-815f-eec3fbb2b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.776706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502636-9e8e-4feb-815f-eec3fbb2b7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.776993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502636-9e8e-4feb-815f-eec3fbb2b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.777270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502636-9e8e-4feb-815f-eec3fbb2b7a3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.777971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502636-9e8e-4feb-815f-eec3fbb2b7a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.779568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502636-9e8e-4feb-815f-eec3fbb2b7a3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.790349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-21502636-9e8e-4feb-815f-eec3fbb2b7a3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:36:36.791940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 451/904] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:36.798307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda466d-6b0d-4c00-b77c-ff4ce2cb201a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.809593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda466d-6b0d-4c00-b77c-ff4ce2cb201a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.814748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.815701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.816210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.816752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.817820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] RBAC: Adding query filter params (name=image) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:36.818331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.820882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.826134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32d69-5f64-4f2a-91f3-376357394490 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.826531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32d69-5f64-4f2a-91f3-376357394490 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.826734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32d69-5f64-4f2a-91f3-376357394490 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.828875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 452/905] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:36.830748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 454/906] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/services?name=image => generated 122 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:36.835566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6cb4f-47d8-4cb3-9ae0-8fdb37074546 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.836161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6cb4f-47d8-4cb3-9ae0-8fdb37074546 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.836161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6cb4f-47d8-4cb3-9ae0-8fdb37074546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.838116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.848045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3494b79-49f6-47b8-832c-69cae85f9a93 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.853993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.854628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.854918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.855704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.856552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] RBAC: Adding query filter params (type=image) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:36.856837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.858365 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.860686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-dbf6cb4f-47d8-4cb3-9ae0-8fdb37074546 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:36.861928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-dbf6cb4f-47d8-4cb3-9ae0-8fdb37074546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:36.869667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 455/907] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:36.872023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 453/908] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:36 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:36.872980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.885501 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a993-bd5a-488b-adfe-0594ef09f0ed admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.892787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.893562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.894039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.894528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.895948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] RBAC: Adding query filter params (interface=public, service_id=2f1cdbd1f50d4d1183020e6c68e57bad, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:36.896478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.896854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6cb4f-47d8-4cb3-9ae0-8fdb37074546 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.899333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.906423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 456/909] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/endpoints?service_id=2f1cdbd1f50d4d1183020e6c68e57bad&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:36.907416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6cb4f-47d8-4cb3-9ae0-8fdb37074546 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.912961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.914281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.914567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.914663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.915071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.916545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.918491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.926026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d29f3-d398-41e5-b871-575e955ab90e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.930445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 16:36:36.930557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.931247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.931539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.931968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.933090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.935627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.936235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 454/910] 10.222.0.48 () {56 vars in 1147 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:36.938746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.943564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 457/911] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:36:36.950859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c564a0-5d30-4884-8609-f9cac3f66d49 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.956205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.956892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.957306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.958555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.958555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:36.959677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.960548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:36.967752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 455/912] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:36.975399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:36.986827 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeae4c7-4486-4e09-8ba2-9cf39ccc108d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:36.992466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757611fd-6c38-4e70-aa0d-c1f59a11da0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:36.993254 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757611fd-6c38-4e70-aa0d-c1f59a11da0d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:36.993624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757611fd-6c38-4e70-aa0d-c1f59a11da0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:36.993947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757611fd-6c38-4e70-aa0d-c1f59a11da0d admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:36.994862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757611fd-6c38-4e70-aa0d-c1f59a11da0d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:36.995208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757611fd-6c38-4e70-aa0d-c1f59a11da0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:36.996982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757611fd-6c38-4e70-aa0d-c1f59a11da0d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:37.010120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 458/913] 10.222.0.48 () {56 vars in 1143 bytes} [Tue Oct 12 16:36:36 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:37.017990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:37.029877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ada800-d0c4-492d-be42-068bd8a359af admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:37.035566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce718ac8-5d9e-4dbb-b218-db4e674eebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:37.036780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718ac8-5d9e-4dbb-b218-db4e674eebee admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:37.037313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718ac8-5d9e-4dbb-b218-db4e674eebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:37.037817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718ac8-5d9e-4dbb-b218-db4e674eebee admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:37.038802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce718ac8-5d9e-4dbb-b218-db4e674eebee admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:37.040629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce718ac8-5d9e-4dbb-b218-db4e674eebee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:37.057490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 456/914] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:37 2021] POST /identity/v3/endpoints => generated 325 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:36:37.668352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f21f-bd2e-4fd0-a900-a52a17f6d681 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:37.668861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f21f-bd2e-4fd0-a900-a52a17f6d681 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:37.669402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367f21f-bd2e-4fd0-a900-a52a17f6d681 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:37.673143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 459/915] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:37 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:37.682846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ce74-67e4-4426-bf16-4009983b5577 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:37.684228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ce74-67e4-4426-bf16-4009983b5577 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:37.684228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ce74-67e4-4426-bf16-4009983b5577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:37.713673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-28c5ce74-67e4-4426-bf16-4009983b5577 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:37.715765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-28c5ce74-67e4-4426-bf16-4009983b5577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:37.749437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 457/916] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:37 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:36:37.778413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367f21f-bd2e-4fd0-a900-a52a17f6d681 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:37.790676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367f21f-bd2e-4fd0-a900-a52a17f6d681 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:37.797306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:37.798270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:37.798638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:37.798856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:37.799513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:37.801113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:37.812970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 16:36:37.814408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 460/917] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:37 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:37.821487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ce74-67e4-4426-bf16-4009983b5577 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:37.831162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ce74-67e4-4426-bf16-4009983b5577 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:37.836759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:37.837559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:37.837913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:37.838288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:37.839457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:37.840593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:37.842543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:37.850540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 458/918] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:37 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:37.855751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:37.867283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e0d2d-43a2-4f45-a8e5-4198e9a77a09 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:37.874856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a23f22-ce49-4d47-9e8c-4de68b9df3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:37.875723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a23f22-ce49-4d47-9e8c-4de68b9df3ff admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:37.876178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a23f22-ce49-4d47-9e8c-4de68b9df3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:37.876178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a23f22-ce49-4d47-9e8c-4de68b9df3ff admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:37.877011 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a23f22-ce49-4d47-9e8c-4de68b9df3ff admin admin] RBAC: Adding query filter params (type=compute) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:37.877481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a23f22-ce49-4d47-9e8c-4de68b9df3ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:37.880003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a23f22-ce49-4d47-9e8c-4de68b9df3ff admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:37.886012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 461/919] 10.222.0.48 () {56 vars in 1133 bytes} [Tue Oct 12 16:36:37 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:37.892167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:37.903820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255268ce-57df-44d4-ba03-925fe33821c3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:37.914168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08511c5-d4bf-4e8a-a716-db7de6ae4f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:37.915287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08511c5-d4bf-4e8a-a716-db7de6ae4f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:37.915804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08511c5-d4bf-4e8a-a716-db7de6ae4f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:37.916259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08511c5-d4bf-4e8a-a716-db7de6ae4f49 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:37.917300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08511c5-d4bf-4e8a-a716-db7de6ae4f49 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:37.919123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08511c5-d4bf-4e8a-a716-db7de6ae4f49 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:37.945711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 459/920] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:37 2021] POST /identity/v3/endpoints => generated 334 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:39.270693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7794-e7d8-478b-be23-93318df6b401 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.271509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7794-e7d8-478b-be23-93318df6b401 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.271509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e7794-e7d8-478b-be23-93318df6b401 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.273901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 462/921] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:39.280214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6359a-6ef0-4b11-bb7c-b4fa10fdc61f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.280710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6359a-6ef0-4b11-bb7c-b4fa10fdc61f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.280783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6359a-6ef0-4b11-bb7c-b4fa10fdc61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.298879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-04d6359a-6ef0-4b11-bb7c-b4fa10fdc61f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:39.300273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-04d6359a-6ef0-4b11-bb7c-b4fa10fdc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:39.322684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 460/922] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:39 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:39.355435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7794-e7d8-478b-be23-93318df6b401 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.370545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e7794-e7d8-478b-be23-93318df6b401 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.375523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.376324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.376608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.376884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] PATH_INFO: `/v3/services/image` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.377594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.379224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.391082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 16:36:39.392436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 463/923] 10.222.0.48 () {56 vars in 1126 bytes} [Tue Oct 12 16:36:39 2021] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:39.399298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6359a-6ef0-4b11-bb7c-b4fa10fdc61f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.408754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6359a-6ef0-4b11-bb7c-b4fa10fdc61f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.413548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.414310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.414654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.414884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.415598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] RBAC: Adding query filter params (name=image) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:39.415906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.417587 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.423009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 461/924] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:39 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:39.429042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.441906 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6365185-f90a-4c6d-b9dd-3581976534be admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.448005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164a81a-d159-4688-97aa-036d8d45a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.448977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164a81a-d159-4688-97aa-036d8d45a936 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.449260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164a81a-d159-4688-97aa-036d8d45a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.449571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164a81a-d159-4688-97aa-036d8d45a936 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.450294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164a81a-d159-4688-97aa-036d8d45a936 admin admin] RBAC: Adding query filter params (type=image) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:39.450600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164a81a-d159-4688-97aa-036d8d45a936 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.452178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164a81a-d159-4688-97aa-036d8d45a936 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.458153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 464/925] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:39 2021] GET /identity/v3/services?type=image => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:39.464763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.475151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38084e-1c46-4e72-b3dc-a08eceadfffe admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.480425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.481178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.481494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.481779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.482547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.484132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.498839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a7f7b-841a-4248-a7a5-c6acdf0f1e7e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.499131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a7f7b-841a-4248-a7a5-c6acdf0f1e7e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.499401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a7f7b-841a-4248-a7a5-c6acdf0f1e7e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.501446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 465/926] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:39.504771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 462/927] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:36:39 2021] POST /identity/v3/endpoints => generated 327 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:39.508724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9cc0-fb2c-407c-8b4a-5b1b46449024 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.509014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9cc0-fb2c-407c-8b4a-5b1b46449024 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.509312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9cc0-fb2c-407c-8b4a-5b1b46449024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.528743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b93e9cc0-fb2c-407c-8b4a-5b1b46449024 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:39.529938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b93e9cc0-fb2c-407c-8b4a-5b1b46449024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:39.551216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 466/928] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:39.576621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.588656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af79fe-b300-4787-8a53-09732fbface7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.593620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd0070-10eb-4a59-9d02-176c5751448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.594442 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0070-10eb-4a59-9d02-176c5751448b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.594727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0070-10eb-4a59-9d02-176c5751448b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.595003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd0070-10eb-4a59-9d02-176c5751448b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.596323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0070-10eb-4a59-9d02-176c5751448b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.598247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd0070-10eb-4a59-9d02-176c5751448b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.600220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 463/929] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:39.607378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9cc0-fb2c-407c-8b4a-5b1b46449024 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:39.616703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9cc0-fb2c-407c-8b4a-5b1b46449024 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:39.621956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889802cd-be90-47c9-9437-66384affd0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:39.622610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889802cd-be90-47c9-9437-66384affd0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:39.622895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889802cd-be90-47c9-9437-66384affd0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:39.623175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889802cd-be90-47c9-9437-66384affd0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:39.623929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889802cd-be90-47c9-9437-66384affd0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:39.625889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889802cd-be90-47c9-9437-66384affd0f8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:39.659903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 467/930] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:36:39 2021] POST /identity/v3/projects => generated 311 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:40.469426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987cf91-ee31-4691-85bf-f47c5e3a56ea None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.470296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987cf91-ee31-4691-85bf-f47c5e3a56ea None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.470580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987cf91-ee31-4691-85bf-f47c5e3a56ea None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.472528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 464/931] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:40.478765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bcffa-fdcc-42f3-96fd-bafe3eddeb14 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.479228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bcffa-fdcc-42f3-96fd-bafe3eddeb14 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.479329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bcffa-fdcc-42f3-96fd-bafe3eddeb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.498646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a12bcffa-fdcc-42f3-96fd-bafe3eddeb14 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:40.499841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a12bcffa-fdcc-42f3-96fd-bafe3eddeb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:40.563081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 468/932] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:40.591293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987cf91-ee31-4691-85bf-f47c5e3a56ea None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.603650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987cf91-ee31-4691-85bf-f47c5e3a56ea None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.608170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.608979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.609262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.609652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.621798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:40.629120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:36:40.630598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 465/933] 10.222.0.48 () {56 vars in 1141 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:40.637701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bcffa-fdcc-42f3-96fd-bafe3eddeb14 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.647030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bcffa-fdcc-42f3-96fd-bafe3eddeb14 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.652422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.653191 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.653582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.653934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.654769 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:40.655144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:40.656958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:40.666537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 469/934] 10.222.0.48 () {56 vars in 1136 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:40.673335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.685628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015152c4-10c1-463b-a296-05b95acc8f9f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.690291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.691093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.691374 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.691648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.703587 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:40.705728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:40.723020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:40.724362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 466/935] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:40.730634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.740554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a53e7c-0f58-44ea-85a4-84f0599b744d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.746167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.746862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.747153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.747437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.748224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:40.748535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:40.750250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:40.769435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 470/936] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:40.772973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.784373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6863946-1632-404e-9317-de8d771152a6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.790094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.792168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.792168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.792168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.799735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:40.801921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:40.816539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:36:40.817989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 467/937] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:40.825144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.836143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908859-7611-4967-b33b-416e50dd0858 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.840873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.841655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.842013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.842381 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.843327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:40.843748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:40.845633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:40.864801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 471/938] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:40.871070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.881070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66a22b-6623-4c64-adaf-5e5566a20990 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.886569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.887225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.887513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.887790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.899150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:40.899150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:40.910073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 468/939] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:36:40.916648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.932078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7efc-5378-4f0b-a0ae-2a73c7831c44 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.936726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.937549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.937839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.938118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:40.949889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:40.951731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:40.969654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:40.971104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 472/940] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:40.978556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:40.990259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f359f-aa95-4b21-9fca-bb7f474f8334 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:40.995638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:40.996511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:40.996864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:40.997285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.000739 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:41.001130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.002875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.015861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 469/941] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:41.022109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.032201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29e735-0ff0-44f3-9dac-fe9291f0e914 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.037249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.038072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.038360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.038639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.050265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.050265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.064697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:41.066156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 473/942] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:41.072847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.083120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30681b9-bffd-45ce-b788-81f0488c9e76 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.087721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45d2c3-6627-4091-9774-c1cac08b0469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.088465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d2c3-6627-4091-9774-c1cac08b0469 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.088814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d2c3-6627-4091-9774-c1cac08b0469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.089159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45d2c3-6627-4091-9774-c1cac08b0469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.090236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d2c3-6627-4091-9774-c1cac08b0469 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:41.090615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d2c3-6627-4091-9774-c1cac08b0469 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.092545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45d2c3-6627-4091-9774-c1cac08b0469 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.106769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 470/943] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:41.113493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.125273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb1ab-c5ef-4761-a48b-1e6a0e1afd46 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.129910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5ffdf-21d4-4b9e-881b-f46a6aefe2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.130617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5ffdf-21d4-4b9e-881b-f46a6aefe2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.130878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5ffdf-21d4-4b9e-881b-f46a6aefe2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.131135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5ffdf-21d4-4b9e-881b-f46a6aefe2c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.131979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5ffdf-21d4-4b9e-881b-f46a6aefe2c0 admin admin] RBAC: Adding query filter params (role.id=a495b5a0c90d469ba925602a6773bed9, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=da3ce1b443aa425c99aab2ca8e6b53c8) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:41.132297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5ffdf-21d4-4b9e-881b-f46a6aefe2c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.134177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5ffdf-21d4-4b9e-881b-f46a6aefe2c0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.140396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 474/944] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/role_assignments?user.id=da3ce1b443aa425c99aab2ca8e6b53c8&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=a495b5a0c90d469ba925602a6773bed9 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:41.850535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7be0c2-a555-49f4-b203-a07afbd9c950 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.851106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7be0c2-a555-49f4-b203-a07afbd9c950 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.851106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7be0c2-a555-49f4-b203-a07afbd9c950 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.853731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 471/945] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:41.860463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0369d4-7995-4181-a59e-a9a9e700206a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.860991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0369d4-7995-4181-a59e-a9a9e700206a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.861098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0369d4-7995-4181-a59e-a9a9e700206a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.880352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9b0369d4-7995-4181-a59e-a9a9e700206a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:41.882080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9b0369d4-7995-4181-a59e-a9a9e700206a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:41.890404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 475/946] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:41.914547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7be0c2-a555-49f4-b203-a07afbd9c950 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.930538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7be0c2-a555-49f4-b203-a07afbd9c950 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.935026 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435a136-682d-4e16-bcdc-1207afa5ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.935674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435a136-682d-4e16-bcdc-1207afa5ea08 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.935959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435a136-682d-4e16-bcdc-1207afa5ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.936235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435a136-682d-4e16-bcdc-1207afa5ea08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.944439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435a136-682d-4e16-bcdc-1207afa5ea08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.946232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435a136-682d-4e16-bcdc-1207afa5ea08 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.956466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 472/947] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:36:41.963505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0369d4-7995-4181-a59e-a9a9e700206a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:41.973042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0369d4-7995-4181-a59e-a9a9e700206a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:41.978970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ec214-e6d5-467e-b51d-ef6c691f5814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:41.979771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ec214-e6d5-467e-b51d-ef6c691f5814 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:41.980060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ec214-e6d5-467e-b51d-ef6c691f5814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:41.980342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ec214-e6d5-467e-b51d-ef6c691f5814 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:41.981565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ec214-e6d5-467e-b51d-ef6c691f5814 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:41.983279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ec214-e6d5-467e-b51d-ef6c691f5814 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:41.987028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 476/948] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:42.005582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b4018-ea7a-493a-9e1d-19c9d15053cc None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:42.005905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b4018-ea7a-493a-9e1d-19c9d15053cc None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:42.006141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b4018-ea7a-493a-9e1d-19c9d15053cc None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:42.008254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 473/949] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:42.014757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fecc8-ccc1-4f61-92e4-be941dd65e13 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:42.015099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fecc8-ccc1-4f61-92e4-be941dd65e13 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:42.015319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fecc8-ccc1-4f61-92e4-be941dd65e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:42.034732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-906fecc8-ccc1-4f61-92e4-be941dd65e13 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:42.035968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-906fecc8-ccc1-4f61-92e4-be941dd65e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:42.046310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 477/950] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:42.072764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b4018-ea7a-493a-9e1d-19c9d15053cc None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:42.086530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b4018-ea7a-493a-9e1d-19c9d15053cc None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:42.091641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ab348-0426-4432-8ab3-530595707506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:42.092445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ab348-0426-4432-8ab3-530595707506 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:42.092725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ab348-0426-4432-8ab3-530595707506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:42.092999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ab348-0426-4432-8ab3-530595707506 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:42.094243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ab348-0426-4432-8ab3-530595707506 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:42.095942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ab348-0426-4432-8ab3-530595707506 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:42.097839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 474/951] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:42.104949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fecc8-ccc1-4f61-92e4-be941dd65e13 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:42.114432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fecc8-ccc1-4f61-92e4-be941dd65e13 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:42.119563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4226a60-7b6b-4032-bb7a-867e93e70b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:42.120264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226a60-7b6b-4032-bb7a-867e93e70b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:42.120551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226a60-7b6b-4032-bb7a-867e93e70b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:42.120830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226a60-7b6b-4032-bb7a-867e93e70b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:42.121627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4226a60-7b6b-4032-bb7a-867e93e70b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:42.123667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4226a60-7b6b-4032-bb7a-867e93e70b7d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:42.145711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 478/952] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:36:42 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:43.416159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f7de-99fa-4652-aa84-eb88347790e0 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.416683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f7de-99fa-4652-aa84-eb88347790e0 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.416769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f7de-99fa-4652-aa84-eb88347790e0 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.418570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 475/953] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:36:43.424663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ac89c-25c0-4b62-8b65-6ac6488c1367 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.425079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ac89c-25c0-4b62-8b65-6ac6488c1367 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.425223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1ac89c-25c0-4b62-8b65-6ac6488c1367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.443216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7f1ac89c-25c0-4b62-8b65-6ac6488c1367 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:43.444415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7f1ac89c-25c0-4b62-8b65-6ac6488c1367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:43.452366 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 479/954] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:43.477826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f7de-99fa-4652-aa84-eb88347790e0 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.490066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f7de-99fa-4652-aa84-eb88347790e0 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.495164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.495968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.496253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.496533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.507038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:43.514502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:36:43.515725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 476/955] 10.222.0.48 () {56 vars in 1141 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:43.522747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ac89c-25c0-4b62-8b65-6ac6488c1367 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.531784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1ac89c-25c0-4b62-8b65-6ac6488c1367 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.536287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.536949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.537232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.537544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.538317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:43.538621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.540857 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.549401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 480/956] 10.222.0.48 () {56 vars in 1136 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:43.556620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.566981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdbc04-4da7-481a-96ef-b075f87ea1e2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.571655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.572434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.572719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.572992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.583805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.586167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.603673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:43.605043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 477/957] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:43.611820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.621756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6506-4a11-40cf-a678-bd1f33fa03dd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.626354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.627009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.627298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.627578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.628319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:43.628628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.630264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.642044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 481/958] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:43.649023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.658813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0aaa-dffb-4c01-b74b-896537fa26ab admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.663397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.664765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.665049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.665322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.672565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.674568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.687903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:36:43.689044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 478/959] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:43.695604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.705937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af5cce-16fa-4b6b-81f2-feb23ebcabda admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.710486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.711649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.711936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.712216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.713060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:43.713454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.715234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.735538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 482/960] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:43.742243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.758939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe434-835f-49eb-ac30-e7dad5cfa6ba admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.769644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.770648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.771102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.771523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.783675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.785817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.804196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:43.805652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 479/961] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:43.812066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.822040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc563a3-96fa-46f3-a5d8-49aa352c072c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.826735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.827398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.827693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.828032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.828773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:43.829349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.831058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.846271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 483/962] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:43.853267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.863661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf635b1-6c60-419d-82a5-6f5abcf6b495 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.868481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.869335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.869689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.869971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.877410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.879366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.896898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:43.898707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 480/963] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:43.905034 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.915420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c05339-5d2b-4715-b73e-00bc80edc24d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.920173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a76d9f-ebca-4d79-8035-93da544beafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.920816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76d9f-ebca-4d79-8035-93da544beafb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.921097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76d9f-ebca-4d79-8035-93da544beafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.921396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a76d9f-ebca-4d79-8035-93da544beafb admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.922180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76d9f-ebca-4d79-8035-93da544beafb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:43.922486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76d9f-ebca-4d79-8035-93da544beafb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.924850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a76d9f-ebca-4d79-8035-93da544beafb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.944006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 484/964] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:43.944678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:43.957173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e504-59aa-4e2a-897f-3dd42617b469 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:43.962747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab3103-2f47-427f-ac8e-7b6e0e3e320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:43.963865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3103-2f47-427f-ac8e-7b6e0e3e320b admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:43.964155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3103-2f47-427f-ac8e-7b6e0e3e320b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:43.964440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3103-2f47-427f-ac8e-7b6e0e3e320b admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/da3ce1b443aa425c99aab2ca8e6b53c8/roles/a495b5a0c90d469ba925602a6773bed9` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:43.966920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3103-2f47-427f-ac8e-7b6e0e3e320b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=da3ce1b443aa425c99aab2ca8e6b53c8, role_id=a495b5a0c90d469ba925602a6773bed9)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:43.970445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab3103-2f47-427f-ac8e-7b6e0e3e320b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:43.993187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 481/965] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:43 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/da3ce1b443aa425c99aab2ca8e6b53c8/roles/a495b5a0c90d469ba925602a6773bed9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:36:44.604156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23288-abf9-47ac-8db1-17e169e0d9a1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.604709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23288-abf9-47ac-8db1-17e169e0d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.604795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23288-abf9-47ac-8db1-17e169e0d9a1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.606617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 485/966] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:44.613205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e226-4c22-4f2d-98fd-a1fcc80c8c57 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.613689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e226-4c22-4f2d-98fd-a1fcc80c8c57 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.613933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e226-4c22-4f2d-98fd-a1fcc80c8c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.631854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c477e226-4c22-4f2d-98fd-a1fcc80c8c57 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:44.633695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c477e226-4c22-4f2d-98fd-a1fcc80c8c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:44.689778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 482/967] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:44.715187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23288-abf9-47ac-8db1-17e169e0d9a1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.727755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23288-abf9-47ac-8db1-17e169e0d9a1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.732224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.733012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.733301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.733620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.744740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:44.751666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:44.752867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 486/968] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:44.759831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e226-4c22-4f2d-98fd-a1fcc80c8c57 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.769242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e226-4c22-4f2d-98fd-a1fcc80c8c57 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.773882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.774553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.774840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.775121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.775890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:44.776197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.777837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.786900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 483/969] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:44.794141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.805673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893b9c1-0dc7-4143-be00-1e99600ae83b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.810559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.811438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.811721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.811999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] PATH_INFO: `/v3/users/f70a33a7bd3947c397e1374c658fe375` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.826336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=f70a33a7bd3947c397e1374c658fe375)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.828540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.830834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 487/970] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/users/f70a33a7bd3947c397e1374c658fe375 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:44.837252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.847494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c44ca-8f75-4e35-b02f-ab0d172dc3af admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.852683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.853429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.853783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.854143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.862304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.864186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.873900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 484/971] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:44.880688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.890467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefac08-2008-4202-bce3-5b3d72fec8e2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.895165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14836e7a-648c-402e-9722-68be3cd5b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.896023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14836e7a-648c-402e-9722-68be3cd5b161 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.896310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14836e7a-648c-402e-9722-68be3cd5b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.896591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14836e7a-648c-402e-9722-68be3cd5b161 admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.897819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14836e7a-648c-402e-9722-68be3cd5b161 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e294ab438ef48a9a71b5903dd0237d6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.899888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14836e7a-648c-402e-9722-68be3cd5b161 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.901629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 488/972] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:36:44.908559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:44.918471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd75852-1ad1-4518-9f89-9ea96e236984 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:44.923226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ccacf-5f11-46f3-9134-3304401e2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:44.923888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ccacf-5f11-46f3-9134-3304401e2aba admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:44.924178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ccacf-5f11-46f3-9134-3304401e2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:44.924458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ccacf-5f11-46f3-9134-3304401e2aba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:44.925314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ccacf-5f11-46f3-9134-3304401e2aba admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=7e294ab438ef48a9a71b5903dd0237d6, user.id=f70a33a7bd3947c397e1374c658fe375) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:44.925663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ccacf-5f11-46f3-9134-3304401e2aba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:44.927521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ccacf-5f11-46f3-9134-3304401e2aba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:44.934042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 485/973] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:44 2021] GET /identity/v3/role_assignments?user.id=f70a33a7bd3947c397e1374c658fe375&scope.project.id=7e294ab438ef48a9a71b5903dd0237d6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:46.383151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ec5a-7e71-4fea-a390-a77401013afc None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.383676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ec5a-7e71-4fea-a390-a77401013afc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.383676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ec5a-7e71-4fea-a390-a77401013afc None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.385417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 489/974] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:46.391467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ccbb0-c4a0-4928-aa9b-2e5968063f68 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.391879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ccbb0-c4a0-4928-aa9b-2e5968063f68 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.392022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ccbb0-c4a0-4928-aa9b-2e5968063f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.409934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9d7ccbb0-c4a0-4928-aa9b-2e5968063f68 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:46.411116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9d7ccbb0-c4a0-4928-aa9b-2e5968063f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:46.418726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 486/975] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:46.443630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ec5a-7e71-4fea-a390-a77401013afc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.457110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ec5a-7e71-4fea-a390-a77401013afc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.462104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.462903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.463187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.463465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.473990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:46.481396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 16:36:46.482589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 490/976] 10.222.0.48 () {56 vars in 1141 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:46.489249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ccbb0-c4a0-4928-aa9b-2e5968063f68 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.498224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ccbb0-c4a0-4928-aa9b-2e5968063f68 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.502754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.503414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.503699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.503979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.504737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:46.505046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.506677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.515384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 487/977] 10.222.0.48 () {56 vars in 1136 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:46.521891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.532562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8acd8-98f9-4bb2-a7a9-ea4d99b029e1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.537051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.537848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.538128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.538399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.548203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.550056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.567356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:46.568593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 491/978] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:46.575981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.586383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b3fae-55d1-4ec5-bda6-5775b307506b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.591013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.591670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.591959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.592240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.592973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:46.593283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.594974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.606935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 488/979] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:46.613320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.623781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32e9f1-29a2-473a-a4ea-40daf569f4f9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.628421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.629198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.629513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.629932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] PATH_INFO: `/v3/users/nova` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.640546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.642475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.656073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 16:36:46.657250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 492/980] 10.222.0.48 () {56 vars in 1114 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:46.663872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.673606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea3a88-f078-4be0-a54e-e514ee1d02c0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.678461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.679130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.679417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.680195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.681045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:46.681359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.683223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.704985 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 489/981] 10.222.0.48 () {56 vars in 1154 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:46.711747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.724503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd560ead-3029-4050-9b23-af67fea7c8ac admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.729161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.729842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.730131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.730408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.738646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.740388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.750265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 493/982] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:36:46.756942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.767076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda62eae-aaa8-4656-b82c-80ead246c467 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.772103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.772883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.773164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.773499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.783663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.785619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.802960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:36:46.804208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 490/983] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:46.811276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.821299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ee8a1-1401-4c1c-ba76-09f0d9e88ad8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.825952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.826620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.826907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.827189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.827928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:46.828237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.830132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.841841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 494/984] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:46.848456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.858563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8add23-2992-4819-9ffe-b0e76a52caf9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.863089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.863871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.864155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.864426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.872082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.874083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.887734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:36:46.888928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 491/985] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:36:46.895658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.905633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa428e-786b-474c-be7b-bc771763ba06 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.910161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a6d65-0650-4bf2-ab2c-ffc4f27bd413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.910802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6d65-0650-4bf2-ab2c-ffc4f27bd413 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.911087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6d65-0650-4bf2-ab2c-ffc4f27bd413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.911359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a6d65-0650-4bf2-ab2c-ffc4f27bd413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.912143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6d65-0650-4bf2-ab2c-ffc4f27bd413 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:46.912451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6d65-0650-4bf2-ab2c-ffc4f27bd413 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.914326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a6d65-0650-4bf2-ab2c-ffc4f27bd413 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.930333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 495/986] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:46.937194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:46.948273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef15682-342c-4db4-8c0d-dea9c7fa9919 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:46.952902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2d3e1-3e8f-4994-b99d-e249d630d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:46.953568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d3e1-3e8f-4994-b99d-e249d630d0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:46.953857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d3e1-3e8f-4994-b99d-e249d630d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:46.954386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2d3e1-3e8f-4994-b99d-e249d630d0e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:46.955231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2d3e1-3e8f-4994-b99d-e249d630d0e1 admin admin] RBAC: Adding query filter params (role.id=a495b5a0c90d469ba925602a6773bed9, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=da3ce1b443aa425c99aab2ca8e6b53c8) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:46.955546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2d3e1-3e8f-4994-b99d-e249d630d0e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:46.957437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2d3e1-3e8f-4994-b99d-e249d630d0e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:46.963456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 492/987] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:46 2021] GET /identity/v3/role_assignments?user.id=da3ce1b443aa425c99aab2ca8e6b53c8&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=a495b5a0c90d469ba925602a6773bed9 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:47.208786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b8b8-957a-4353-b3da-706c7ad1ebeb None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.209206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b8b8-957a-4353-b3da-706c7ad1ebeb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.209560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14b8b8-957a-4353-b3da-706c7ad1ebeb None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.212506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 496/988] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:47 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:47.220379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb876-a992-4ebc-90b2-42a5b03a2f08 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.220821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb876-a992-4ebc-90b2-42a5b03a2f08 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.221207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb876-a992-4ebc-90b2-42a5b03a2f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.240266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7a4eb876-a992-4ebc-90b2-42a5b03a2f08 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:47.241513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7a4eb876-a992-4ebc-90b2-42a5b03a2f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:47.249647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 493/989] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:47.275297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b8b8-957a-4353-b3da-706c7ad1ebeb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.288261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14b8b8-957a-4353-b3da-706c7ad1ebeb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.294754 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.295714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.296008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.296379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.308615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:47.315534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:47.316899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 497/990] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:47.324295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb876-a992-4ebc-90b2-42a5b03a2f08 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.334129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb876-a992-4ebc-90b2-42a5b03a2f08 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.338927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.339591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.340107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.340345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.340897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:47.341201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:47.342824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:47.353802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 494/991] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:47.360582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.373492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15654b08-0b48-4969-8e10-0236150be2da admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.378318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.379218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.379537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.379821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] PATH_INFO: `/v3/users/f70a33a7bd3947c397e1374c658fe375` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.381842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] RBAC: Authorizing `identity:get_user(user_id=f70a33a7bd3947c397e1374c658fe375)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:47.383874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:47.385522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 498/992] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/users/f70a33a7bd3947c397e1374c658fe375 => generated 285 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:47.392972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.403553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965b50-89bd-4cc0-81ea-a7260589cdc8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.408428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4745b-bf79-48c7-80f6-5b9ca683b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.409326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4745b-bf79-48c7-80f6-5b9ca683b398 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.409673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4745b-bf79-48c7-80f6-5b9ca683b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.409950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4745b-bf79-48c7-80f6-5b9ca683b398 admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.411159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4745b-bf79-48c7-80f6-5b9ca683b398 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e294ab438ef48a9a71b5903dd0237d6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:47.413203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4745b-bf79-48c7-80f6-5b9ca683b398 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:47.415290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 495/993] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:47 2021] GET /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:47.423888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:47.435599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899fdb-2ba0-4cd4-8eba-2797c4cb3f1b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:47.440502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d52e4-a40b-413a-98e6-f6dc5e86bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:47.441440 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d52e4-a40b-413a-98e6-f6dc5e86bf8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:47.441737 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d52e4-a40b-413a-98e6-f6dc5e86bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:47.442023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d52e4-a40b-413a-98e6-f6dc5e86bf8a admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6/users/f70a33a7bd3947c397e1374c658fe375/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:47.444060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d52e4-a40b-413a-98e6-f6dc5e86bf8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e294ab438ef48a9a71b5903dd0237d6, user_id=f70a33a7bd3947c397e1374c658fe375, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:47.447348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d52e4-a40b-413a-98e6-f6dc5e86bf8a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:47.462362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 499/994] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:47 2021] PUT /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6/users/f70a33a7bd3947c397e1374c658fe375/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:49.757334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aedad-69a1-4981-b67c-9a14504d972c None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:49.757951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aedad-69a1-4981-b67c-9a14504d972c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:49.757951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641aedad-69a1-4981-b67c-9a14504d972c None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:49.759784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 496/995] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:49.765803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47823cf-87c7-4501-b8c6-d07b08f3c03e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:49.766328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47823cf-87c7-4501-b8c6-d07b08f3c03e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:49.766421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47823cf-87c7-4501-b8c6-d07b08f3c03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:49.784443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e47823cf-87c7-4501-b8c6-d07b08f3c03e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:49.785705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e47823cf-87c7-4501-b8c6-d07b08f3c03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:49.847171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 500/996] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:49.874833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aedad-69a1-4981-b67c-9a14504d972c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:49.887849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641aedad-69a1-4981-b67c-9a14504d972c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:49.892462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:49.893280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:49.893621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:49.893901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:49.906940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:36:49.914003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:36:49.915750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 497/997] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:36:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:36:49.922719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47823cf-87c7-4501-b8c6-d07b08f3c03e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:49.931685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47823cf-87c7-4501-b8c6-d07b08f3c03e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:49.936262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:49.936922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:49.937205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:49.937511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:49.938273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:49.938576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:49.940172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:49.949538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 501/998] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:36:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:49.956739 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:49.968762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a49d6-ee9c-4f1d-9405-dabd39c353a3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:49.973352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:49.974280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:49.974558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:49.974832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] PATH_INFO: `/v3/users/f70a33a7bd3947c397e1374c658fe375` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:49.976084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=f70a33a7bd3947c397e1374c658fe375)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:49.978262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:49.979906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 498/999] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:49 2021] GET /identity/v3/users/f70a33a7bd3947c397e1374c658fe375 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:49.991328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:50.002688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b04b2-72b4-4354-8221-ec1a7e11c371 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:50.007232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:50.008455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:50.008675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:50.008951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:50.017523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:50.019305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:50.028882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 502/1000] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:50.035538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:50.045534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a92be-499a-4688-8f0d-177d21d442e5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:50.050526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4a19a-fa42-4a04-8ef3-c17eb9264e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:50.051372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a19a-fa42-4a04-8ef3-c17eb9264e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:50.051654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a19a-fa42-4a04-8ef3-c17eb9264e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:50.051927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a19a-fa42-4a04-8ef3-c17eb9264e13 admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:50.053101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4a19a-fa42-4a04-8ef3-c17eb9264e13 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e294ab438ef48a9a71b5903dd0237d6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:50.055201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4a19a-fa42-4a04-8ef3-c17eb9264e13 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:50.056897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 499/1001] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:50 2021] GET /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:50.063863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:50.073406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93611-7ac7-4b90-a29c-164c8469b4fb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:50.078051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a55a-e0d4-4fdc-b741-f903549007f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:50.078704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a55a-e0d4-4fdc-b741-f903549007f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:50.078996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a55a-e0d4-4fdc-b741-f903549007f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:50.079278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a55a-e0d4-4fdc-b741-f903549007f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:50.080380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a55a-e0d4-4fdc-b741-f903549007f4 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=7e294ab438ef48a9a71b5903dd0237d6, user.id=f70a33a7bd3947c397e1374c658fe375) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:50.080697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a55a-e0d4-4fdc-b741-f903549007f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:50.082582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a55a-e0d4-4fdc-b741-f903549007f4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:50.089459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 503/1002] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:50 2021] GET /identity/v3/role_assignments?user.id=f70a33a7bd3947c397e1374c658fe375&scope.project.id=7e294ab438ef48a9a71b5903dd0237d6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:52.393805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fac20d-aeae-47b3-8a75-f7a371eb3eac None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:52.394373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fac20d-aeae-47b3-8a75-f7a371eb3eac None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:52.394373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fac20d-aeae-47b3-8a75-f7a371eb3eac None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:52.396044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 500/1003] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:52.402639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4b6c-311a-4687-a159-dde4fc4f53a4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:52.403082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4b6c-311a-4687-a159-dde4fc4f53a4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:52.403196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e4b6c-311a-4687-a159-dde4fc4f53a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:52.420311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-901e4b6c-311a-4687-a159-dde4fc4f53a4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:52.421524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-901e4b6c-311a-4687-a159-dde4fc4f53a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:52.429020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 504/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:52.454879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fac20d-aeae-47b3-8a75-f7a371eb3eac None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:52.468124 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fac20d-aeae-47b3-8a75-f7a371eb3eac None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:52.472663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e580448-25d8-4201-83df-6b65f1be3f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:52.473508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580448-25d8-4201-83df-6b65f1be3f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:52.473796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580448-25d8-4201-83df-6b65f1be3f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:52.474073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e580448-25d8-4201-83df-6b65f1be3f34 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:52.475268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e580448-25d8-4201-83df-6b65f1be3f34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:52.476954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e580448-25d8-4201-83df-6b65f1be3f34 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:52.478584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 501/1005] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:36:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:52.484764 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e4b6c-311a-4687-a159-dde4fc4f53a4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:52.493600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e4b6c-311a-4687-a159-dde4fc4f53a4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:52.498132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b64a5b-96f7-43ad-8bb5-bf232fb7ebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:52.498784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b64a5b-96f7-43ad-8bb5-bf232fb7ebad admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:52.499068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b64a5b-96f7-43ad-8bb5-bf232fb7ebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:52.499342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b64a5b-96f7-43ad-8bb5-bf232fb7ebad admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:52.500073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b64a5b-96f7-43ad-8bb5-bf232fb7ebad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:52.501993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b64a5b-96f7-43ad-8bb5-bf232fb7ebad admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:52.522177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 505/1006] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:36:52 2021] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:36:54.844057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6b38-2142-4364-8651-6f708a42f622 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.844637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6b38-2142-4364-8651-6f708a42f622 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.844637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6b38-2142-4364-8651-6f708a42f622 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.846423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 502/1007] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:54.853045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9e36b-f6b7-42d8-b736-9ee640f2adc1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.853525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9e36b-f6b7-42d8-b736-9ee640f2adc1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.853721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9e36b-f6b7-42d8-b736-9ee640f2adc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.871038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2fb9e36b-f6b7-42d8-b736-9ee640f2adc1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:54.872243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2fb9e36b-f6b7-42d8-b736-9ee640f2adc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:54.880678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 506/1008] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:54.906153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6b38-2142-4364-8651-6f708a42f622 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:54.918878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6b38-2142-4364-8651-6f708a42f622 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:54.923262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:54.924119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.924405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.924684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] PATH_INFO: `/v3/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.926235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] RBAC: Authorizing `identity:get_role(role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:54.927277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:54.927277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:36:54.927277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:36:54.928153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:54.929543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 503/1009] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:54 2021] GET /identity/v3/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:54.936190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9e36b-f6b7-42d8-b736-9ee640f2adc1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:54.945335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9e36b-f6b7-42d8-b736-9ee640f2adc1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:54.950197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:54.951072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.951358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.951640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] PATH_INFO: `/v3/users/9e536803a2bf41479d4b32a72449ea4a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:54.967135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] RBAC: Authorizing `identity:get_user(user_id=9e536803a2bf41479d4b32a72449ea4a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:54.969281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:54.970995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 507/1010] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:54 2021] GET /identity/v3/users/9e536803a2bf41479d4b32a72449ea4a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:54.978703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:54.988729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92890cee-52c7-45d3-8e24-7d98a8756f15 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:54.993418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:54.994059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:54.994345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:54.994622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.003201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.004967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.014374 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 504/1011] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:54 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:55.021112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.031493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250ddde-ec3b-45b3-8f0f-0b4f9233059f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.036051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aabafa-e6e7-4e95-8d92-320dd74a64b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.036889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aabafa-e6e7-4e95-8d92-320dd74a64b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.037176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aabafa-e6e7-4e95-8d92-320dd74a64b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.037497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aabafa-e6e7-4e95-8d92-320dd74a64b7 admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.038680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aabafa-e6e7-4e95-8d92-320dd74a64b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e294ab438ef48a9a71b5903dd0237d6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.041418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aabafa-e6e7-4e95-8d92-320dd74a64b7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.043108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 508/1012] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:55.050122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:55.059347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881ea54-dc0c-4a2b-abd6-2a86ef4506c7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:55.063893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaacd04-6381-420b-9d83-e1b9066a7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:55.064534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaacd04-6381-420b-9d83-e1b9066a7299 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:55.064824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaacd04-6381-420b-9d83-e1b9066a7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:55.065099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaacd04-6381-420b-9d83-e1b9066a7299 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:55.065979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaacd04-6381-420b-9d83-e1b9066a7299 admin admin] RBAC: Adding query filter params (role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=7e294ab438ef48a9a71b5903dd0237d6, user.id=9e536803a2bf41479d4b32a72449ea4a) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:36:55.066293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaacd04-6381-420b-9d83-e1b9066a7299 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:55.068121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaacd04-6381-420b-9d83-e1b9066a7299 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:55.073945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 505/1013] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:55 2021] GET /identity/v3/role_assignments?user.id=9e536803a2bf41479d4b32a72449ea4a&scope.project.id=7e294ab438ef48a9a71b5903dd0237d6&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:57.334673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b598a9-60bb-45c9-b4a3-6c3a76e09e59 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:57.335194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b598a9-60bb-45c9-b4a3-6c3a76e09e59 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:57.335194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b598a9-60bb-45c9-b4a3-6c3a76e09e59 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:57.337457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 509/1014] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:57.343808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837e73c-97e7-4070-acca-372147e98e63 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:57.344317 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837e73c-97e7-4070-acca-372147e98e63 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:57.344421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837e73c-97e7-4070-acca-372147e98e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:57.366463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b837e73c-97e7-4070-acca-372147e98e63 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:57.367705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b837e73c-97e7-4070-acca-372147e98e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:57.375586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 506/1015] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:57.400282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b598a9-60bb-45c9-b4a3-6c3a76e09e59 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:57.412381 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b598a9-60bb-45c9-b4a3-6c3a76e09e59 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:57.417758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:57.418587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:57.418872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:57.419151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] PATH_INFO: `/v3/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:57.420625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] RBAC: Authorizing `identity:get_role(role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:57.421675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:36:57.421675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:36:57.421675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:36:57.422542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:57.423870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 510/1016] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:57 2021] GET /identity/v3/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:57.430314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837e73c-97e7-4070-acca-372147e98e63 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:57.439108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837e73c-97e7-4070-acca-372147e98e63 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:57.443563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:57.444401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:57.444678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:57.444949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] PATH_INFO: `/v3/users/9e536803a2bf41479d4b32a72449ea4a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:57.446819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] RBAC: Authorizing `identity:get_user(user_id=9e536803a2bf41479d4b32a72449ea4a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:57.448911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:57.450533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 507/1017] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:57 2021] GET /identity/v3/users/9e536803a2bf41479d4b32a72449ea4a => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:57.456817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:57.466845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc14792-962b-4ab8-8d49-4eeb20abddc5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:57.471321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bb8f5-3546-4468-9ad2-4ce4c2c3cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:57.472149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bb8f5-3546-4468-9ad2-4ce4c2c3cbcf admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:57.472445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bb8f5-3546-4468-9ad2-4ce4c2c3cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:57.472728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bb8f5-3546-4468-9ad2-4ce4c2c3cbcf admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:57.473929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bb8f5-3546-4468-9ad2-4ce4c2c3cbcf admin admin] RBAC: Authorizing `identity:get_project(project_id=7e294ab438ef48a9a71b5903dd0237d6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:57.475940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bb8f5-3546-4468-9ad2-4ce4c2c3cbcf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:57.477631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 511/1018] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:57 2021] GET /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:57.483949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:57.493320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba71513-20da-471c-8e27-b1512c58dc8a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:57.497894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c703ff-aae9-43ad-8951-d4347c7d3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:57.498740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c703ff-aae9-43ad-8951-d4347c7d3d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:57.499022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c703ff-aae9-43ad-8951-d4347c7d3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:57.499299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c703ff-aae9-43ad-8951-d4347c7d3d31 admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6/users/9e536803a2bf41479d4b32a72449ea4a/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:57.501492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c703ff-aae9-43ad-8951-d4347c7d3d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e294ab438ef48a9a71b5903dd0237d6, user_id=9e536803a2bf41479d4b32a72449ea4a, role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:57.504215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c703ff-aae9-43ad-8951-d4347c7d3d31 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:57.516967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 508/1019] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:36:57 2021] PUT /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6/users/9e536803a2bf41479d4b32a72449ea4a/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:36:59.748873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c72646-4498-4c4c-9b93-c60e07d320ed None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.749447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c72646-4498-4c4c-9b93-c60e07d320ed None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.749565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c72646-4498-4c4c-9b93-c60e07d320ed None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.751281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 512/1020] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:36:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:36:59.758271 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130128ce-4cf1-4743-8339-64868761d5ef None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.758734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130128ce-4cf1-4743-8339-64868761d5ef None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.758823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130128ce-4cf1-4743-8339-64868761d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.776795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-130128ce-4cf1-4743-8339-64868761d5ef None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:36:59.778013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-130128ce-4cf1-4743-8339-64868761d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:36:59.838171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 509/1021] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:36:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:36:59.862623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c72646-4498-4c4c-9b93-c60e07d320ed None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:59.874748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c72646-4498-4c4c-9b93-c60e07d320ed None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:59.879095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:59.879917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.880199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.880475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] PATH_INFO: `/v3/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.881960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] RBAC: Authorizing `identity:get_role(role_id=9ba1d2c4d5e6461ea49b103ff3b8b88d)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:59.884058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:59.885527 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 513/1022] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:59 2021] GET /identity/v3/roles/9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:59.891971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130128ce-4cf1-4743-8339-64868761d5ef None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:59.901452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130128ce-4cf1-4743-8339-64868761d5ef None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:59.906012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:59.906899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.907187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.907469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] PATH_INFO: `/v3/users/9e536803a2bf41479d4b32a72449ea4a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.908688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] RBAC: Authorizing `identity:get_user(user_id=9e536803a2bf41479d4b32a72449ea4a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:59.910863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:59.912475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 510/1023] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:36:59 2021] GET /identity/v3/users/9e536803a2bf41479d4b32a72449ea4a => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:59.919085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:59.928667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95a04-48cc-4ea5-855e-c45fce352480 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:59.933153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:59.933819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.934104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.934381 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.942676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:59.944419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:59.953948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 514/1024] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:36:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:36:59.960845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:36:59.971190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73be1b-355a-4900-bfcb-67e3780f081c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:36:59.976551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcf464-4bee-40d8-92b6-b35abe7a6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:36:59.977446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcf464-4bee-40d8-92b6-b35abe7a6175 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:36:59.977731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcf464-4bee-40d8-92b6-b35abe7a6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:36:59.978005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcf464-4bee-40d8-92b6-b35abe7a6175 admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:36:59.979202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcf464-4bee-40d8-92b6-b35abe7a6175 admin admin] RBAC: Authorizing `identity:get_project(project_id=7e294ab438ef48a9a71b5903dd0237d6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:36:59.981219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcf464-4bee-40d8-92b6-b35abe7a6175 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:36:59.982928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 511/1025] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:36:59 2021] GET /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:36:59.989801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:00.000359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f705a4-68bf-47e9-b3c5-b8e0c0131836 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:00.005099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a50ebb-be23-4d3d-a362-8c32821cb8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:00.005791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a50ebb-be23-4d3d-a362-8c32821cb8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:00.006075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a50ebb-be23-4d3d-a362-8c32821cb8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:00.006349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a50ebb-be23-4d3d-a362-8c32821cb8ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:00.007192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a50ebb-be23-4d3d-a362-8c32821cb8ec admin admin] RBAC: Adding query filter params (role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d, scope.project.id=7e294ab438ef48a9a71b5903dd0237d6, user.id=9e536803a2bf41479d4b32a72449ea4a) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:00.007503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a50ebb-be23-4d3d-a362-8c32821cb8ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:00.010068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a50ebb-be23-4d3d-a362-8c32821cb8ec admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:00.016430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 515/1026] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:36:59 2021] GET /identity/v3/role_assignments?user.id=9e536803a2bf41479d4b32a72449ea4a&scope.project.id=7e294ab438ef48a9a71b5903dd0237d6&role.id=9ba1d2c4d5e6461ea49b103ff3b8b88d => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.310257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711fedb-2510-4192-a5eb-973f6defca62 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.310765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711fedb-2510-4192-a5eb-973f6defca62 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.310765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711fedb-2510-4192-a5eb-973f6defca62 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.312483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 512/1027] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:02.318640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45451dc-284b-4b75-82f6-12ff95c0d98a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.319120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45451dc-284b-4b75-82f6-12ff95c0d98a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.319214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45451dc-284b-4b75-82f6-12ff95c0d98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.337746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b45451dc-284b-4b75-82f6-12ff95c0d98a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:02.338970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b45451dc-284b-4b75-82f6-12ff95c0d98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:02.346680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 516/1028] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:02.372024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711fedb-2510-4192-a5eb-973f6defca62 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.384989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711fedb-2510-4192-a5eb-973f6defca62 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.389553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb6ea6-15a2-43d0-99a0-bcf38de2b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.390361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6ea6-15a2-43d0-99a0-bcf38de2b730 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.390643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6ea6-15a2-43d0-99a0-bcf38de2b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.390917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb6ea6-15a2-43d0-99a0-bcf38de2b730 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.392139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb6ea6-15a2-43d0-99a0-bcf38de2b730 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.393865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb6ea6-15a2-43d0-99a0-bcf38de2b730 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.395533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 513/1029] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:02.402342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45451dc-284b-4b75-82f6-12ff95c0d98a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:02.411448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45451dc-284b-4b75-82f6-12ff95c0d98a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:02.416152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591449e4-39b4-427a-918b-df13959107b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:02.416846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591449e4-39b4-427a-918b-df13959107b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:02.417136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591449e4-39b4-427a-918b-df13959107b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:02.417458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591449e4-39b4-427a-918b-df13959107b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:02.418228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591449e4-39b4-427a-918b-df13959107b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:02.420169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591449e4-39b4-427a-918b-df13959107b9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:02.447165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 517/1030] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:37:02 2021] POST /identity/v3/projects => generated 311 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:04.765500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf00b6-26a3-4499-a172-80c5f0ee76a2 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.766043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf00b6-26a3-4499-a172-80c5f0ee76a2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.766043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf00b6-26a3-4499-a172-80c5f0ee76a2 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.767816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 514/1031] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:04.774545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97debcc-be5f-42d9-b0b2-5564c9908e83 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.775002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97debcc-be5f-42d9-b0b2-5564c9908e83 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.775093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97debcc-be5f-42d9-b0b2-5564c9908e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.793835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c97debcc-be5f-42d9-b0b2-5564c9908e83 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:04.795063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c97debcc-be5f-42d9-b0b2-5564c9908e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:04.853809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 518/1032] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:37:04.880059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf00b6-26a3-4499-a172-80c5f0ee76a2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.892427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf00b6-26a3-4499-a172-80c5f0ee76a2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.896832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b33360-51dc-4da0-9273-371f15b019c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.897735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33360-51dc-4da0-9273-371f15b019c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.898028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33360-51dc-4da0-9273-371f15b019c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.898306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33360-51dc-4da0-9273-371f15b019c7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.900024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b33360-51dc-4da0-9273-371f15b019c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.901759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b33360-51dc-4da0-9273-371f15b019c7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.903390 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 515/1033] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:37:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:04.909967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97debcc-be5f-42d9-b0b2-5564c9908e83 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:04.920348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97debcc-be5f-42d9-b0b2-5564c9908e83 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:04.925120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53796c39-9112-4035-8b51-18c259d9d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:04.925846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796c39-9112-4035-8b51-18c259d9d7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:04.926138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796c39-9112-4035-8b51-18c259d9d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:04.926422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796c39-9112-4035-8b51-18c259d9d7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:04.927175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53796c39-9112-4035-8b51-18c259d9d7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:04.929142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53796c39-9112-4035-8b51-18c259d9d7aa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:04.950854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 519/1034] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:04 2021] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:07.305688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341497f2-6b41-435a-8805-787ca5b2f4c0 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.306206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341497f2-6b41-435a-8805-787ca5b2f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.306206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341497f2-6b41-435a-8805-787ca5b2f4c0 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.307974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 516/1035] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:07.314862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41208-ca61-438a-85f8-8ea25f2a8ebc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.315389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41208-ca61-438a-85f8-8ea25f2a8ebc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.315481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba41208-ca61-438a-85f8-8ea25f2a8ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.333317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bba41208-ca61-438a-85f8-8ea25f2a8ebc None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:07.334551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bba41208-ca61-438a-85f8-8ea25f2a8ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:07.342338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 520/1036] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:07.369401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341497f2-6b41-435a-8805-787ca5b2f4c0 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.381647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341497f2-6b41-435a-8805-787ca5b2f4c0 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.386232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.387016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.387306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.387589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.397737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:07.404540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:07.405751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 517/1037] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:07.412577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41208-ca61-438a-85f8-8ea25f2a8ebc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.422114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba41208-ca61-438a-85f8-8ea25f2a8ebc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.429067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.430360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.430649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.430929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.431689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:07.431997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.433622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.442031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 521/1038] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:07.448656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.459316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac278e-ce04-47ef-8615-b6e2092ee5aa admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.463956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.464812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.465100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.465391 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] PATH_INFO: `/v3/users/4899b324ddbd41d6981a3c258acd19c5` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.479914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] RBAC: Authorizing `identity:get_user(user_id=4899b324ddbd41d6981a3c258acd19c5)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.482110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.483852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 518/1039] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/users/4899b324ddbd41d6981a3c258acd19c5 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:07.490516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.500768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c5cce-d7af-421e-9db9-9d7cd60d9e15 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.505457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.506112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.506399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.506677 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.515162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.516950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.526313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 522/1040] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:07.533360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.543542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9120f-a016-4f1c-a9dc-e4051807a1ae admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.548031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c1f01-cd3d-4b99-9a9c-22e5b178a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.548864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1f01-cd3d-4b99-9a9c-22e5b178a0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.549153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1f01-cd3d-4b99-9a9c-22e5b178a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.549459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c1f01-cd3d-4b99-9a9c-22e5b178a0d0 admin admin] PATH_INFO: `/v3/projects/5d40943e3fb14e179bf297f0bc46469a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.550642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c1f01-cd3d-4b99-9a9c-22e5b178a0d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5d40943e3fb14e179bf297f0bc46469a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.552651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c1f01-cd3d-4b99-9a9c-22e5b178a0d0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.554337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 519/1041] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/projects/5d40943e3fb14e179bf297f0bc46469a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:07.561828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:07.570848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fe7c5-fd6f-4217-b058-8751b03be63b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:07.575547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0a53-b860-4f12-a1ef-ca066565674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:07.576201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0a53-b860-4f12-a1ef-ca066565674c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:07.576491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0a53-b860-4f12-a1ef-ca066565674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:07.576775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0a53-b860-4f12-a1ef-ca066565674c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:07.577654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0a53-b860-4f12-a1ef-ca066565674c admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=5d40943e3fb14e179bf297f0bc46469a, user.id=4899b324ddbd41d6981a3c258acd19c5) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:07.577974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0a53-b860-4f12-a1ef-ca066565674c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:07.579814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f0a53-b860-4f12-a1ef-ca066565674c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:07.585843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 523/1042] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:07 2021] GET /identity/v3/role_assignments?user.id=4899b324ddbd41d6981a3c258acd19c5&scope.project.id=5d40943e3fb14e179bf297f0bc46469a&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:09.827817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce7bf-4375-46dd-b262-b966d15ede7e None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.831051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce7bf-4375-46dd-b262-b966d15ede7e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.831051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce7bf-4375-46dd-b262-b966d15ede7e None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.831051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 520/1043] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:09.836614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70764dc-500a-4a53-9418-690d0201e119 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.837043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70764dc-500a-4a53-9418-690d0201e119 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.837174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70764dc-500a-4a53-9418-690d0201e119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.855173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d70764dc-500a-4a53-9418-690d0201e119 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:09.856506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d70764dc-500a-4a53-9418-690d0201e119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:09.864218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 524/1044] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:09.888821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bce7bf-4375-46dd-b262-b966d15ede7e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.900742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bce7bf-4375-46dd-b262-b966d15ede7e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.905085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.905881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.906162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.906433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.916241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:09.922986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:09.924151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 521/1045] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:09.931473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70764dc-500a-4a53-9418-690d0201e119 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.940314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70764dc-500a-4a53-9418-690d0201e119 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.944854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.946256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.946547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.946824 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.947578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:09.947899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:09.949486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:09.957952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 525/1046] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:09.964546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:09.975936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a00c0d-17e3-4539-bd67-644dba85ee40 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:09.980520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:09.981350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:09.981662 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:09.981935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] PATH_INFO: `/v3/users/4899b324ddbd41d6981a3c258acd19c5` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:09.983126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=4899b324ddbd41d6981a3c258acd19c5)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:09.985254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:09.986844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 522/1047] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/users/4899b324ddbd41d6981a3c258acd19c5 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:09.993768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.003641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d334277-dc0b-4ffd-a937-822638b65e33 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.008746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419d039-201c-498d-9f22-4fdb28eb05b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.009627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d039-201c-498d-9f22-4fdb28eb05b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.009911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d039-201c-498d-9f22-4fdb28eb05b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.010185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d039-201c-498d-9f22-4fdb28eb05b5 admin admin] PATH_INFO: `/v3/projects/5d40943e3fb14e179bf297f0bc46469a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.011361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419d039-201c-498d-9f22-4fdb28eb05b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5d40943e3fb14e179bf297f0bc46469a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.013384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419d039-201c-498d-9f22-4fdb28eb05b5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.015142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 526/1048] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:09 2021] GET /identity/v3/projects/5d40943e3fb14e179bf297f0bc46469a => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:10.021847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:10.031564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfd026-a5f2-47a0-9bbb-71fe6172c9c2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:10.036134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51c7c-1829-466b-bf3b-2f15ec44a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:10.036997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51c7c-1829-466b-bf3b-2f15ec44a242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:10.037283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51c7c-1829-466b-bf3b-2f15ec44a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:10.037615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51c7c-1829-466b-bf3b-2f15ec44a242 admin admin] PATH_INFO: `/v3/projects/5d40943e3fb14e179bf297f0bc46469a/users/4899b324ddbd41d6981a3c258acd19c5/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:10.039589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51c7c-1829-466b-bf3b-2f15ec44a242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d40943e3fb14e179bf297f0bc46469a, user_id=4899b324ddbd41d6981a3c258acd19c5, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:10.042259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51c7c-1829-466b-bf3b-2f15ec44a242 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:10.056075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 523/1049] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:10 2021] PUT /identity/v3/projects/5d40943e3fb14e179bf297f0bc46469a/users/4899b324ddbd41d6981a3c258acd19c5/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:12.292326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166598f5-d500-49f3-99dc-76c1ce920121 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.292840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166598f5-d500-49f3-99dc-76c1ce920121 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.292840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166598f5-d500-49f3-99dc-76c1ce920121 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.294639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 527/1050] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:12.300843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaa4e1-3675-4db0-86b5-ecf06eb8659e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.301254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaa4e1-3675-4db0-86b5-ecf06eb8659e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.301429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaa4e1-3675-4db0-86b5-ecf06eb8659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.318659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3dbaa4e1-3675-4db0-86b5-ecf06eb8659e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:12.319846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3dbaa4e1-3675-4db0-86b5-ecf06eb8659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:12.378600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 524/1051] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:12.404210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166598f5-d500-49f3-99dc-76c1ce920121 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.416904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166598f5-d500-49f3-99dc-76c1ce920121 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.421247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.422171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.422459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.422740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.432751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:12.439558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:12.440726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 528/1052] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:12.448008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaa4e1-3675-4db0-86b5-ecf06eb8659e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.457026 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaa4e1-3675-4db0-86b5-ecf06eb8659e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.462413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.463058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.463336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.463608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.464355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:12.464656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.466267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.474402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 525/1053] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:12.480871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.491265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248bcf3-74c2-4912-8919-7070feb593c5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.496670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.497560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.497850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.498133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] PATH_INFO: `/v3/users/4899b324ddbd41d6981a3c258acd19c5` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.499411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=4899b324ddbd41d6981a3c258acd19c5)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.501571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.503157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 529/1054] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/users/4899b324ddbd41d6981a3c258acd19c5 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:12.510205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.519688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716eb1c7-80b6-415b-b67e-b0108c641f88 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.524838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.525525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.525935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.526059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.533643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.535370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.543941 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 526/1055] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:12.550419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.560283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81448d-846b-43df-b622-de883cb085f9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.564819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54abd74-d99e-4615-8289-dc986107fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.565694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abd74-d99e-4615-8289-dc986107fa42 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.565981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abd74-d99e-4615-8289-dc986107fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.566262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54abd74-d99e-4615-8289-dc986107fa42 admin admin] PATH_INFO: `/v3/projects/5d40943e3fb14e179bf297f0bc46469a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.567448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abd74-d99e-4615-8289-dc986107fa42 admin admin] RBAC: Authorizing `identity:get_project(project_id=5d40943e3fb14e179bf297f0bc46469a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.569518 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54abd74-d99e-4615-8289-dc986107fa42 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.571713 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 530/1056] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/projects/5d40943e3fb14e179bf297f0bc46469a => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:37:12.578697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:12.588414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099c312-a478-4ff3-8abc-96ee32cf24c8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:12.593334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7fde1-9635-4103-b048-0c83ce00992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:12.593995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7fde1-9635-4103-b048-0c83ce00992c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:12.594278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7fde1-9635-4103-b048-0c83ce00992c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:12.594553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7fde1-9635-4103-b048-0c83ce00992c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:12.595380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7fde1-9635-4103-b048-0c83ce00992c admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=5d40943e3fb14e179bf297f0bc46469a, user.id=4899b324ddbd41d6981a3c258acd19c5) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:12.595690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7fde1-9635-4103-b048-0c83ce00992c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:12.597540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7fde1-9635-4103-b048-0c83ce00992c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:12.603434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 527/1057] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:12 2021] GET /identity/v3/role_assignments?user.id=4899b324ddbd41d6981a3c258acd19c5&scope.project.id=5d40943e3fb14e179bf297f0bc46469a&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:14.880839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b77b-94d2-4235-bae3-4f68aa82f201 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.881460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b77b-94d2-4235-bae3-4f68aa82f201 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.881460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b77b-94d2-4235-bae3-4f68aa82f201 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.883221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 531/1058] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:14.889387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5bec-e863-481b-8ada-da6e546e7975 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.889827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5bec-e863-481b-8ada-da6e546e7975 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.889973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5bec-e863-481b-8ada-da6e546e7975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.907140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a2dd5bec-e863-481b-8ada-da6e546e7975 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:14.908336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a2dd5bec-e863-481b-8ada-da6e546e7975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:14.916525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 528/1059] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:14.940499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557b77b-94d2-4235-bae3-4f68aa82f201 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.952642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557b77b-94d2-4235-bae3-4f68aa82f201 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.957424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.958073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.958363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.958644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:14.966840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:14.968592 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:14.978008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 532/1060] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:14.984672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5bec-e863-481b-8ada-da6e546e7975 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:14.994092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5bec-e863-481b-8ada-da6e546e7975 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:14.998611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff982-3448-45a3-9bbb-ad48340c2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:14.999397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff982-3448-45a3-9bbb-ad48340c2bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:14.999679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff982-3448-45a3-9bbb-ad48340c2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:14.999954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff982-3448-45a3-9bbb-ad48340c2bcc admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.006798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff982-3448-45a3-9bbb-ad48340c2bcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.008596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff982-3448-45a3-9bbb-ad48340c2bcc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.022700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fffff982-3448-45a3-9bbb-ad48340c2bcc admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 12 16:37:15.023832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 529/1061] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:37:14 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:15.030517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:15.039686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b6ba8-2c2a-4bf6-8081-c588273cfb71 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:15.044300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec39070-380e-49e8-9659-ae68730ce52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:15.044932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec39070-380e-49e8-9659-ae68730ce52c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:15.045212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec39070-380e-49e8-9659-ae68730ce52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:15.045515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec39070-380e-49e8-9659-ae68730ce52c admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:15.046235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec39070-380e-49e8-9659-ae68730ce52c admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:15.046536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec39070-380e-49e8-9659-ae68730ce52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:15.048079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec39070-380e-49e8-9659-ae68730ce52c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:15.055793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 533/1062] 10.222.0.48 () {56 vars in 1136 bytes} [Tue Oct 12 16:37:15 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:17.268111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d39cb-ae40-47ef-b27e-58be01d33039 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.268621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d39cb-ae40-47ef-b27e-58be01d33039 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.268621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d39cb-ae40-47ef-b27e-58be01d33039 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.270394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 530/1063] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:17.276386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39899b-49ab-4f9c-87f2-f54d5f98b80c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.276797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39899b-49ab-4f9c-87f2-f54d5f98b80c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.276947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39899b-49ab-4f9c-87f2-f54d5f98b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.294889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9d39899b-49ab-4f9c-87f2-f54d5f98b80c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:17.296112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9d39899b-49ab-4f9c-87f2-f54d5f98b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:17.304188 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 534/1064] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:17.330028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d39cb-ae40-47ef-b27e-58be01d33039 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:17.343583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d39cb-ae40-47ef-b27e-58be01d33039 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:17.347968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb79cb-f37b-478d-8139-16c6f5068843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:17.348620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb79cb-f37b-478d-8139-16c6f5068843 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:17.348904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb79cb-f37b-478d-8139-16c6f5068843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:17.349181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb79cb-f37b-478d-8139-16c6f5068843 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:17.349962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb79cb-f37b-478d-8139-16c6f5068843 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:17.351005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-33fb79cb-f37b-478d-8139-16c6f5068843 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:37:17.351005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:37:17.351005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:37:17.352476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb79cb-f37b-478d-8139-16c6f5068843 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:17.369518 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 531/1065] 10.222.0.48 () {60 vars in 1159 bytes} [Tue Oct 12 16:37:17 2021] POST /identity/v3/domains => generated 267 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:19.675405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaccd7-de78-4ce9-ab00-cbd785e30979 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.675945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaccd7-de78-4ce9-ab00-cbd785e30979 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.676052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaccd7-de78-4ce9-ab00-cbd785e30979 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.677807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 535/1066] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:19.684369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf05ffd-7836-4f6f-94ed-5748f357574f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.684830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf05ffd-7836-4f6f-94ed-5748f357574f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.684923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf05ffd-7836-4f6f-94ed-5748f357574f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.703174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5bf05ffd-7836-4f6f-94ed-5748f357574f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:19.704372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5bf05ffd-7836-4f6f-94ed-5748f357574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:19.761741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 532/1067] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:19.786567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaccd7-de78-4ce9-ab00-cbd785e30979 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.798817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaccd7-de78-4ce9-ab00-cbd785e30979 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.803126 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df057-be7b-49c5-8409-e1fe280e0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.803948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df057-be7b-49c5-8409-e1fe280e0b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.804229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df057-be7b-49c5-8409-e1fe280e0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.804502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df057-be7b-49c5-8409-e1fe280e0b96 admin admin] PATH_INFO: `/v3/domains/c0b502921e4f4a57ab2da07023551135` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.816962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3df057-be7b-49c5-8409-e1fe280e0b96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c0b502921e4f4a57ab2da07023551135)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.819111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3df057-be7b-49c5-8409-e1fe280e0b96 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.821395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 536/1068] 10.222.0.48 () {56 vars in 1204 bytes} [Tue Oct 12 16:37:19 2021] GET /identity/v3/domains/c0b502921e4f4a57ab2da07023551135 => generated 267 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:19.828046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf05ffd-7836-4f6f-94ed-5748f357574f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:19.837156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf05ffd-7836-4f6f-94ed-5748f357574f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:19.841748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ed39d-6fdd-41b7-84b8-44eae3a71f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:19.842395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed39d-6fdd-41b7-84b8-44eae3a71f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:19.842683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed39d-6fdd-41b7-84b8-44eae3a71f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:19.842965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed39d-6fdd-41b7-84b8-44eae3a71f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:19.843688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed39d-6fdd-41b7-84b8-44eae3a71f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:19.845593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed39d-6fdd-41b7-84b8-44eae3a71f8b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:19.874525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 533/1069] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:37:19 2021] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:22.137039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30636a3-d17b-4569-9125-d525e449e298 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:22.137656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30636a3-d17b-4569-9125-d525e449e298 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:22.137656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30636a3-d17b-4569-9125-d525e449e298 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:22.139414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 537/1070] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:22.145398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388582-e4ad-4669-acfe-37ed50fde991 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:22.145839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388582-e4ad-4669-acfe-37ed50fde991 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:22.145939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388582-e4ad-4669-acfe-37ed50fde991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:22.163544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0e388582-e4ad-4669-acfe-37ed50fde991 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:22.165332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0e388582-e4ad-4669-acfe-37ed50fde991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:22.222491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 534/1071] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:22.248477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30636a3-d17b-4569-9125-d525e449e298 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:22.261076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30636a3-d17b-4569-9125-d525e449e298 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:22.265353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5545e-3677-4f24-8054-fb0845eb4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:22.266224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5545e-3677-4f24-8054-fb0845eb4c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:22.266510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5545e-3677-4f24-8054-fb0845eb4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:22.266788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5545e-3677-4f24-8054-fb0845eb4c43 admin admin] PATH_INFO: `/v3/domains/c0b502921e4f4a57ab2da07023551135` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:22.267995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5545e-3677-4f24-8054-fb0845eb4c43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c0b502921e4f4a57ab2da07023551135)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:22.270264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5545e-3677-4f24-8054-fb0845eb4c43 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:22.271825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 538/1072] 10.222.0.48 () {56 vars in 1204 bytes} [Tue Oct 12 16:37:22 2021] GET /identity/v3/domains/c0b502921e4f4a57ab2da07023551135 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:22.278469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e388582-e4ad-4669-acfe-37ed50fde991 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:22.287123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e388582-e4ad-4669-acfe-37ed50fde991 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:22.293303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42e3a6-3a6a-4989-afdd-82fcbc73d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:22.293978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42e3a6-3a6a-4989-afdd-82fcbc73d981 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:22.294259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42e3a6-3a6a-4989-afdd-82fcbc73d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:22.294534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42e3a6-3a6a-4989-afdd-82fcbc73d981 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:22.295263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42e3a6-3a6a-4989-afdd-82fcbc73d981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:22.297145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42e3a6-3a6a-4989-afdd-82fcbc73d981 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:22.316108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 535/1073] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:37:22 2021] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:37:24.578927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bcde4-63fd-4e00-9b7c-d8cf06bdded9 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.579492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bcde4-63fd-4e00-9b7c-d8cf06bdded9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.579492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040bcde4-63fd-4e00-9b7c-d8cf06bdded9 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.581533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 539/1074] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:24.587337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97af79e-dca1-4bc1-a156-8814c7a5d9ca None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.587782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97af79e-dca1-4bc1-a156-8814c7a5d9ca None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.587882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97af79e-dca1-4bc1-a156-8814c7a5d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.605501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f97af79e-dca1-4bc1-a156-8814c7a5d9ca None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:24.606687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f97af79e-dca1-4bc1-a156-8814c7a5d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:24.614298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 536/1075] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:24.639024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bcde4-63fd-4e00-9b7c-d8cf06bdded9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.650812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040bcde4-63fd-4e00-9b7c-d8cf06bdded9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.655132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.655888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.656167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.656438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.667043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:24.673768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:24.674881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 540/1076] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:24.682001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97af79e-dca1-4bc1-a156-8814c7a5d9ca None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.690630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97af79e-dca1-4bc1-a156-8814c7a5d9ca None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.695329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.695966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.696245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.696516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.697265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:24.697599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.699172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.707489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 537/1077] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:24.713580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.722820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85b9e-2831-47cf-a60b-67a0b0cc0331 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.727788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.728609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.728889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.729160 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] PATH_INFO: `/v3/users/1f85d22e54b9445081a7e1b47258fc33` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.742063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] RBAC: Authorizing `identity:get_user(user_id=1f85d22e54b9445081a7e1b47258fc33)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.744825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.746441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 541/1078] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:24 2021] GET /identity/v3/users/1f85d22e54b9445081a7e1b47258fc33 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:24.754032 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.763403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185f81f-5fa0-41e7-b1aa-b208fe3f3e00 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.767806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a41315-6543-4359-8192-e069affa041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.768423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41315-6543-4359-8192-e069affa041f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.768708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41315-6543-4359-8192-e069affa041f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.768982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a41315-6543-4359-8192-e069affa041f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.776427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a41315-6543-4359-8192-e069affa041f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.778208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a41315-6543-4359-8192-e069affa041f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.786832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 538/1079] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:24 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:24.793904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.803231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9e7e-d8b0-4436-ba7c-436908f99dca admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.808404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7b769-2244-4774-8630-1982ff4bf37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.809229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b769-2244-4774-8630-1982ff4bf37d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.809553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b769-2244-4774-8630-1982ff4bf37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.809828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b769-2244-4774-8630-1982ff4bf37d admin admin] PATH_INFO: `/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.810992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7b769-2244-4774-8630-1982ff4bf37d admin admin] RBAC: Authorizing `identity:get_project(project_id=a8811b64990c4a0ea56cbcf09918f4dc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.813059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7b769-2244-4774-8630-1982ff4bf37d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.814769 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 542/1080] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:24 2021] GET /identity/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:24.821530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a41315-6543-4359-8192-e069affa041f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:24.830355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a41315-6543-4359-8192-e069affa041f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:24.835129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc8cfa-30a2-4937-abf3-03549d93eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:24.835759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8cfa-30a2-4937-abf3-03549d93eeeb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:24.836540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8cfa-30a2-4937-abf3-03549d93eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:24.836819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc8cfa-30a2-4937-abf3-03549d93eeeb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:24.837697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc8cfa-30a2-4937-abf3-03549d93eeeb admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=a8811b64990c4a0ea56cbcf09918f4dc, user.id=1f85d22e54b9445081a7e1b47258fc33) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:24.838111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc8cfa-30a2-4937-abf3-03549d93eeeb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:24.839979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc8cfa-30a2-4937-abf3-03549d93eeeb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:24.845143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 539/1081] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:24 2021] GET /identity/v3/role_assignments?user.id=1f85d22e54b9445081a7e1b47258fc33&scope.project.id=a8811b64990c4a0ea56cbcf09918f4dc&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.049159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d462d94-636b-464d-9da2-65036a351f5e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.049756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d462d94-636b-464d-9da2-65036a351f5e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.049862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d462d94-636b-464d-9da2-65036a351f5e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.051644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 543/1082] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:27.058069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4f36-1f7c-42d1-991d-b4e09d7805fb None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.058483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4f36-1f7c-42d1-991d-b4e09d7805fb None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.058624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a4f36-1f7c-42d1-991d-b4e09d7805fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.076477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-fc0a4f36-1f7c-42d1-991d-b4e09d7805fb None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:27.077680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fc0a4f36-1f7c-42d1-991d-b4e09d7805fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:27.085457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 540/1083] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:27.108589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d462d94-636b-464d-9da2-65036a351f5e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.121051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d462d94-636b-464d-9da2-65036a351f5e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.125313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.126138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.126421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.126694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.137121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:27.143749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:27.144856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 544/1084] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:27.151428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a4f36-1f7c-42d1-991d-b4e09d7805fb None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.160347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a4f36-1f7c-42d1-991d-b4e09d7805fb None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.164830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.165522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.165808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.166085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.166837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:27.167144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.168709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.176752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 541/1085] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.183620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.193691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6726172a-b147-4102-9fe3-2bb458310084 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.198704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.199534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.199820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.200141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] PATH_INFO: `/v3/users/1f85d22e54b9445081a7e1b47258fc33` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.201331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] RBAC: Authorizing `identity:get_user(user_id=1f85d22e54b9445081a7e1b47258fc33)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.203490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.205392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 545/1086] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/users/1f85d22e54b9445081a7e1b47258fc33 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.211769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.220943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d446841-14cd-41be-ba6f-c00efab5f37c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.225385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a7733-daac-4ec6-9ade-416d85738722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.226224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a7733-daac-4ec6-9ade-416d85738722 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.226509 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a7733-daac-4ec6-9ade-416d85738722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.226848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a7733-daac-4ec6-9ade-416d85738722 admin admin] PATH_INFO: `/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.228021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a7733-daac-4ec6-9ade-416d85738722 admin admin] RBAC: Authorizing `identity:get_project(project_id=a8811b64990c4a0ea56cbcf09918f4dc)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.230109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a7733-daac-4ec6-9ade-416d85738722 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.231728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 542/1087] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:27 2021] GET /identity/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:27.237864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:27.247499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7296c-3feb-43e1-9e3e-a9d8b140a9da admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:27.252314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a4965-faf6-45e0-9196-2d17e26278db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:27.253096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a4965-faf6-45e0-9196-2d17e26278db admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:27.253400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a4965-faf6-45e0-9196-2d17e26278db admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:27.253679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a4965-faf6-45e0-9196-2d17e26278db admin admin] PATH_INFO: `/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc/users/1f85d22e54b9445081a7e1b47258fc33/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:27.255587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a4965-faf6-45e0-9196-2d17e26278db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8811b64990c4a0ea56cbcf09918f4dc, user_id=1f85d22e54b9445081a7e1b47258fc33, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:27.258761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a4965-faf6-45e0-9196-2d17e26278db admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:27.272061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 546/1088] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:37:27 2021] PUT /identity/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc/users/1f85d22e54b9445081a7e1b47258fc33/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:37:29.483314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85eebd-2119-487c-9664-026883b58271 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.483833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85eebd-2119-487c-9664-026883b58271 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.483833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85eebd-2119-487c-9664-026883b58271 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.485601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 543/1089] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:37:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:37:29.491751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d7d3-6b68-4a47-a7ae-62d58de264d5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.492131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d7d3-6b68-4a47-a7ae-62d58de264d5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.492847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d7d3-6b68-4a47-a7ae-62d58de264d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.510501 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9966d7d3-6b68-4a47-a7ae-62d58de264d5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:37:29.511671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9966d7d3-6b68-4a47-a7ae-62d58de264d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:37:29.566243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 547/1090] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:37:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:37:29.591716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85eebd-2119-487c-9664-026883b58271 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:29.603877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85eebd-2119-487c-9664-026883b58271 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:29.608237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:29.609013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.609299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.609608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.620168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:37:29.627054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:37:29.628208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 544/1091] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:37:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:37:29.635481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966d7d3-6b68-4a47-a7ae-62d58de264d5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:29.644219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966d7d3-6b68-4a47-a7ae-62d58de264d5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:29.648735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:29.649398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.649694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.649973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.650728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:29.651035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:29.652605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:29.660524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 548/1092] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:37:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:29.666869 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:29.676881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05921a-98aa-4e7b-87c2-c8b0aef50e3e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:29.682048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:29.682879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.683164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.683439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] PATH_INFO: `/v3/users/1f85d22e54b9445081a7e1b47258fc33` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.684635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f85d22e54b9445081a7e1b47258fc33)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:29.686795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:29.688347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 545/1093] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:37:29 2021] GET /identity/v3/users/1f85d22e54b9445081a7e1b47258fc33 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:29.694396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:29.704171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c3ff4-a06b-4d53-afe6-8d17a0f7d455 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:29.708870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:29.709529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.709817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.710094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.717438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:29.719153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:29.728031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 549/1094] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:37:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:37:29.734399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:29.744179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb17c25-2391-40f2-894e-239212d3ad84 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:29.748709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad86900-c6b6-4540-a61b-aab91004984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:29.749564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86900-c6b6-4540-a61b-aab91004984e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.749853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86900-c6b6-4540-a61b-aab91004984e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.750134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad86900-c6b6-4540-a61b-aab91004984e admin admin] PATH_INFO: `/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.751314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad86900-c6b6-4540-a61b-aab91004984e admin admin] RBAC: Authorizing `identity:get_project(project_id=a8811b64990c4a0ea56cbcf09918f4dc)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:29.753325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad86900-c6b6-4540-a61b-aab91004984e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:29.754993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 546/1095] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:37:29 2021] GET /identity/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:37:29.761264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:37:29.769817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a5b46-fd56-4a41-8d76-554637293376 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:37:29.774358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c68d05-7bb2-4f49-8036-3255280408a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:37:29.774972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c68d05-7bb2-4f49-8036-3255280408a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:37:29.775256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c68d05-7bb2-4f49-8036-3255280408a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:37:29.775532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c68d05-7bb2-4f49-8036-3255280408a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:37:29.776355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c68d05-7bb2-4f49-8036-3255280408a0 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=a8811b64990c4a0ea56cbcf09918f4dc, user.id=1f85d22e54b9445081a7e1b47258fc33) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:37:29.776668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c68d05-7bb2-4f49-8036-3255280408a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:37:29.778491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c68d05-7bb2-4f49-8036-3255280408a0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:37:29.783912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 550/1096] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:37:29 2021] GET /identity/v3/role_assignments?user.id=1f85d22e54b9445081a7e1b47258fc33&scope.project.id=a8811b64990c4a0ea56cbcf09918f4dc&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:26.120867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6834-63d7-40c2-9a14-7ec57a89a377 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:26.121462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6834-63d7-40c2-9a14-7ec57a89a377 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:26.121462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6834-63d7-40c2-9a14-7ec57a89a377 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:26.123394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 547/1097] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:26.131428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e64bbb-ad7d-4d88-84c5-e3600658a082 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:26.131428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e64bbb-ad7d-4d88-84c5-e3600658a082 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:26.131428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e64bbb-ad7d-4d88-84c5-e3600658a082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:26.149306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-40e64bbb-ad7d-4d88-84c5-e3600658a082 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:26.150896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-40e64bbb-ad7d-4d88-84c5-e3600658a082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:26.159871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 551/1098] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:26.186941 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f6834-63d7-40c2-9a14-7ec57a89a377 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:26.200493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f6834-63d7-40c2-9a14-7ec57a89a377 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:26.206074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:26.207343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:26.208204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:26.208696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:26.221879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:26.224270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:26.248297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:26.250027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 548/1099] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:26.257689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e64bbb-ad7d-4d88-84c5-e3600658a082 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:26.268210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e64bbb-ad7d-4d88-84c5-e3600658a082 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:26.275120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fca3e7-14ec-4d3b-ac69-785984b419c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:26.276151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca3e7-14ec-4d3b-ac69-785984b419c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:26.276785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca3e7-14ec-4d3b-ac69-785984b419c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:26.276918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fca3e7-14ec-4d3b-ac69-785984b419c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:26.282186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fca3e7-14ec-4d3b-ac69-785984b419c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:26.282186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fca3e7-14ec-4d3b-ac69-785984b419c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:26.283577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fca3e7-14ec-4d3b-ac69-785984b419c2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:26.296673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 552/1100] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:26.303118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:26.316908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf151-3362-453c-9c99-d7379e70c66b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:26.326917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825397de-ecf9-496d-b7ec-e119f4a73fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:26.327594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825397de-ecf9-496d-b7ec-e119f4a73fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:26.327933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825397de-ecf9-496d-b7ec-e119f4a73fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:26.328137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825397de-ecf9-496d-b7ec-e119f4a73fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:26.328924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825397de-ecf9-496d-b7ec-e119f4a73fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:26.331005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825397de-ecf9-496d-b7ec-e119f4a73fa6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:26.355931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 549/1101] 10.222.0.48 () {60 vars in 1153 bytes} [Tue Oct 12 16:38:26 2021] POST /identity/v3/users => generated 251 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:38:28.844612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12833c-e08d-4c01-83f0-6ac130eaff3e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.845311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12833c-e08d-4c01-83f0-6ac130eaff3e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.845311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12833c-e08d-4c01-83f0-6ac130eaff3e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.849425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 553/1102] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:28.854102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661deae-b1d4-4d6e-be58-6cf4474b1305 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.854577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661deae-b1d4-4d6e-be58-6cf4474b1305 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.854665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661deae-b1d4-4d6e-be58-6cf4474b1305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.874968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2661deae-b1d4-4d6e-be58-6cf4474b1305 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:28.876450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2661deae-b1d4-4d6e-be58-6cf4474b1305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:28.886217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 550/1103] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:28.915026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12833c-e08d-4c01-83f0-6ac130eaff3e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:28.930513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12833c-e08d-4c01-83f0-6ac130eaff3e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:28.935397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:28.936188 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.936471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.936841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.948571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:28.955443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:38:28.956650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 554/1104] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:28.964223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661deae-b1d4-4d6e-be58-6cf4474b1305 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:28.973165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661deae-b1d4-4d6e-be58-6cf4474b1305 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:28.977905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:28.978618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:28.978821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:28.979101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:28.979852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:28.980150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:28.981889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:28.990784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 551/1105] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:28.998530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.009219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e392-8676-44e4-9c51-908d29e5baa0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.014369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.015258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.015462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.015703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.029628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.032152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.052730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:29.053947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 555/1106] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:29.061663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.073643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31892-35d7-4a01-b94a-d154376a3736 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.080572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.081237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.081572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.081887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.083309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:29.083535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.085522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.104152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 552/1107] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:29.109966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.120331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5920-0bd2-4e7c-9fc6-b028c0a2aebd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.125661 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.126546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.126883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.127168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.135466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.137594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.154447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:38:29.155955 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 556/1108] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:29.162943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.177694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05adab4-c6ee-4fef-a124-d743ffd03f91 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.183879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.184544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.184831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.185122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.185983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:29.186304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.188644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.211621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 553/1109] 10.222.0.48 () {56 vars in 1164 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:29.220114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.230579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452dba1-650e-45c0-9c3e-e675772fe23c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.235769 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.236577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.236942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.237508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.246339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.248301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.260200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 557/1110] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:29.266711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.279924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2698-4ba8-4059-b8c1-c2a24036cde2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.285429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.286342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.286707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.287913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.298538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.300359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.318055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:29.319238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 554/1111] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:29.326360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.336379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a09f22-8573-4afd-becd-19c9181f9a45 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.341853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.342750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.343067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.343324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.344086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:29.344397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.346058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.358391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 558/1112] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:29.365005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.375856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577566bf-21b0-4c02-97ec-1802b5c7a3f8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.382423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.384037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.384458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.384876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.393880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.396397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.416197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:29.418121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 555/1113] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:29.424601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.435237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74d7c-abba-412b-bd50-d64e048e0651 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.441136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf4eeb-b9e5-4cdd-878b-ed68c0697550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.442099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4eeb-b9e5-4cdd-878b-ed68c0697550 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.442709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4eeb-b9e5-4cdd-878b-ed68c0697550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.443101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf4eeb-b9e5-4cdd-878b-ed68c0697550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.444262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4eeb-b9e5-4cdd-878b-ed68c0697550 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:29.444680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4eeb-b9e5-4cdd-878b-ed68c0697550 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.447202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf4eeb-b9e5-4cdd-878b-ed68c0697550 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.468260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 559/1114] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:29.475592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:29.488758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60d38-ebe0-4d4e-963d-a418d0f45de2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:29.495329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce92a3d-f077-4eec-8d33-046fb313087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:29.496045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce92a3d-f077-4eec-8d33-046fb313087f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:29.496331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce92a3d-f077-4eec-8d33-046fb313087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:29.496611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce92a3d-f077-4eec-8d33-046fb313087f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:29.497630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce92a3d-f077-4eec-8d33-046fb313087f admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=32dbbc4af72f4d11a9b1876dba8e886f) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:29.498867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce92a3d-f077-4eec-8d33-046fb313087f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:29.500109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce92a3d-f077-4eec-8d33-046fb313087f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:29.506375 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 556/1115] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:29 2021] GET /identity/v3/role_assignments?user.id=32dbbc4af72f4d11a9b1876dba8e886f&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:31.794605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af26d-fb15-49c4-ad20-ad00bf0a04d7 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:31.795176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af26d-fb15-49c4-ad20-ad00bf0a04d7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:31.795176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af26d-fb15-49c4-ad20-ad00bf0a04d7 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:31.796917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 560/1116] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:31.803114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a09cc-6289-43df-a49b-e25c711229e5 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:31.803552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a09cc-6289-43df-a49b-e25c711229e5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:31.803655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a09cc-6289-43df-a49b-e25c711229e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:31.823080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-fd4a09cc-6289-43df-a49b-e25c711229e5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:31.824255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fd4a09cc-6289-43df-a49b-e25c711229e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:31.832321 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 557/1117] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:31.856007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af26d-fb15-49c4-ad20-ad00bf0a04d7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:31.870896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af26d-fb15-49c4-ad20-ad00bf0a04d7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:31.876159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:31.876926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:31.877206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:31.877512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:31.893984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:31.901044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:38:31.902566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 561/1118] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:38:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:31.909205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a09cc-6289-43df-a49b-e25c711229e5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:31.918045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a09cc-6289-43df-a49b-e25c711229e5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:31.922635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:31.923285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:31.926017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:31.926017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:31.926017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] RBAC: Adding query filter params (name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:31.926017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:31.926464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:31.936091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 558/1119] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:38:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:31.943192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:31.954542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a391d-50f0-4d56-ba31-b6ebd376a6bb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:31.960408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:31.961322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:31.961750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:31.962129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:31.973999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:31.976885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:31.995600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:32.002203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 562/1120] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:32.004772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.016317 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a195a-97da-4741-81b0-b966c75cee5b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.022447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.023340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.023722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.024067 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.025255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:32.025633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.027715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.048258 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 559/1121] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:32.055663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.066747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a03928-3ea3-4afa-b256-30f84d0d93fb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.072450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.073260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.073601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.073877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.082609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.084989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.101084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:38:32.103623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 563/1122] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:32.110383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.122838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1cfb1-7d3d-4ec0-ba41-9ec28949f253 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.128821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.129555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.129842 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.130117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.130966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:32.131302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.134609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.151680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 560/1123] 10.222.0.48 () {56 vars in 1164 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:32.158473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.168686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d61fc8-24bb-4543-a504-15f26109fd6e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.173445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.174331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.174718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.175093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.186491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.188467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.207225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:32.208840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 564/1124] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:32.215961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.227329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7ce89-99e4-4651-92a1-27be42888066 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.233196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.234000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.234392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.234767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.235580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:32.235962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.239164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.253604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 561/1125] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:32.259694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.272380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa426c-a4e6-44b6-9902-38df120f2226 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.277742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.278666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.279012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.279358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.286644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.288683 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.302634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:32.304026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 565/1126] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:32.311276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.322684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7195b8-12b5-4e5a-aab0-d32f4d8f92df admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.327665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156828c7-c95d-4567-9d62-14e76ccc25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.328398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156828c7-c95d-4567-9d62-14e76ccc25ea admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.328655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156828c7-c95d-4567-9d62-14e76ccc25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.328979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156828c7-c95d-4567-9d62-14e76ccc25ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.329900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156828c7-c95d-4567-9d62-14e76ccc25ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:32.330180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156828c7-c95d-4567-9d62-14e76ccc25ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.333628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156828c7-c95d-4567-9d62-14e76ccc25ea admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.347613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 562/1127] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:32.355073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:32.367394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267b847-4013-4842-9546-2f9cb0d70e06 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:32.372862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af017e-91ab-4894-9e00-eb617110b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:32.373818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af017e-91ab-4894-9e00-eb617110b99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:32.374096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af017e-91ab-4894-9e00-eb617110b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:32.374412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af017e-91ab-4894-9e00-eb617110b99c admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/32dbbc4af72f4d11a9b1876dba8e886f/roles/b0384dab922047ac99e3d88dcd0535a3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:32.390131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af017e-91ab-4894-9e00-eb617110b99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=32dbbc4af72f4d11a9b1876dba8e886f, role_id=b0384dab922047ac99e3d88dcd0535a3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:32.393036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af017e-91ab-4894-9e00-eb617110b99c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:32.409414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 566/1128] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:38:32 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/32dbbc4af72f4d11a9b1876dba8e886f/roles/b0384dab922047ac99e3d88dcd0535a3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:38:35.003666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6176a9-be8d-4409-929b-59c79952ddd9 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.004434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6176a9-be8d-4409-929b-59c79952ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.004434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6176a9-be8d-4409-929b-59c79952ddd9 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.006047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 563/1129] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:35.013079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8430ce-eab0-4321-88cf-00d1c0200871 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.013671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8430ce-eab0-4321-88cf-00d1c0200871 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.013850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8430ce-eab0-4321-88cf-00d1c0200871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.033241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ef8430ce-eab0-4321-88cf-00d1c0200871 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:35.034671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ef8430ce-eab0-4321-88cf-00d1c0200871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:35.100147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 567/1130] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:35.127425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6176a9-be8d-4409-929b-59c79952ddd9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.142323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6176a9-be8d-4409-929b-59c79952ddd9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.146955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.147857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.148197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.148546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.160295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:35.168491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 16:38:35.170098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 564/1131] 10.222.0.48 () {56 vars in 1123 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:35.176702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8430ce-eab0-4321-88cf-00d1c0200871 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.186755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8430ce-eab0-4321-88cf-00d1c0200871 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.191516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.192165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.192504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.192844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.193635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] RBAC: Adding query filter params (name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.193981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.195624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.203902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 568/1132] 10.222.0.48 () {56 vars in 1124 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:35.210724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.220986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046e9a0-8cdb-432b-b3ec-7e43544c478b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.225596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.226919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.227196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.227469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.238038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.240151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.257975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:35.259079 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 565/1133] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:35.265773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.275504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce931504-1e6c-441f-b741-dd2bb6e8ad18 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.280856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.281681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.282076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.282462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.283311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.283692 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.285526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.298852 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 569/1134] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:35.306133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.315737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f086-c929-49d8-a295-78ec49f9bc6b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.320267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.321042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.321329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.321637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.328726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.330827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.345836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:38:35.346998 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 566/1135] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:35.354561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.364791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cd278-ad86-43e7-ae82-9781e8e48600 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.369585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.370325 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.370679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.371035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.372033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.372402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.374400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.393165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 570/1136] 10.222.0.48 () {56 vars in 1164 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:35.400203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.409926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb879b-5992-44e8-92f0-30a84b811617 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.415097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.415726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.416013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.416289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.424296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.426262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.436148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 567/1137] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:35.442687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.452351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb6f07-be80-4b17-b0e0-dc7eebf7dfcb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.456934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.457742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.458025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.458567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.469624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.471438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.489265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:35.490448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 571/1138] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:35.497005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.506109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41eb20-dcc0-4dcb-98ad-2e8689a127f9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.511593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.512614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.513052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.513617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.514364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.514739 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.516433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.528929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 568/1139] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:35.535361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.548114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e45587-8e3f-4556-90e5-8bd55bbb4529 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.554172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.555574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.555870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.556292 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.564515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.566498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.583865 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:35.585276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 572/1140] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:35.593299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.604016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2d2bc-8dca-4d82-98a7-659330f853c1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.609172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522f98d-4898-4cba-bbde-42337739b2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.609857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f98d-4898-4cba-bbde-42337739b2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.610143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f98d-4898-4cba-bbde-42337739b2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.610414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f98d-4898-4cba-bbde-42337739b2a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.611274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522f98d-4898-4cba-bbde-42337739b2a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.611644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522f98d-4898-4cba-bbde-42337739b2a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.613522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522f98d-4898-4cba-bbde-42337739b2a5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.628144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 569/1141] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:35.634898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:35.646533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f131f88-7b29-400b-9e5b-ea4601c8117c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:35.652684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b55d2-1532-45fd-b8c8-7920a6a6b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:35.653526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b55d2-1532-45fd-b8c8-7920a6a6b351 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:35.653813 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b55d2-1532-45fd-b8c8-7920a6a6b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:35.654093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b55d2-1532-45fd-b8c8-7920a6a6b351 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:35.655083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b55d2-1532-45fd-b8c8-7920a6a6b351 admin admin] RBAC: Adding query filter params (role.id=b0384dab922047ac99e3d88dcd0535a3, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=32dbbc4af72f4d11a9b1876dba8e886f) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:35.655601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b55d2-1532-45fd-b8c8-7920a6a6b351 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:35.657993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b55d2-1532-45fd-b8c8-7920a6a6b351 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:35.665578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 573/1142] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:35 2021] GET /identity/v3/role_assignments?user.id=32dbbc4af72f4d11a9b1876dba8e886f&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=b0384dab922047ac99e3d88dcd0535a3 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:38.001068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce8077-e710-4ac6-b136-8aa928b6ca00 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.001636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce8077-e710-4ac6-b136-8aa928b6ca00 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.001636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce8077-e710-4ac6-b136-8aa928b6ca00 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.003762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 570/1143] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:38.012236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e591529-0ee4-4aa6-9f77-86d2be0d89e7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.012721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e591529-0ee4-4aa6-9f77-86d2be0d89e7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.012924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e591529-0ee4-4aa6-9f77-86d2be0d89e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.031963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4e591529-0ee4-4aa6-9f77-86d2be0d89e7 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:38.033448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4e591529-0ee4-4aa6-9f77-86d2be0d89e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:38.042377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 574/1144] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:38.075140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce8077-e710-4ac6-b136-8aa928b6ca00 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.088808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce8077-e710-4ac6-b136-8aa928b6ca00 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.093436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.094294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.094617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.094965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.106628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:38.113499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:38.114709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 571/1145] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:38.122069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e591529-0ee4-4aa6-9f77-86d2be0d89e7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.131374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e591529-0ee4-4aa6-9f77-86d2be0d89e7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.136392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.137049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.137337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.137649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.138406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:38.138716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.140298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.149058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 575/1146] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:38.155434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.166384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7681d76-5924-4006-9bc4-7d43f1bbe57a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.171207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.171977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.172264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.172542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.184394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.186273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.203439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:38.204911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 572/1147] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:38.212167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.222737 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84285db-87cf-454e-afca-f5cc30c429fa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.228555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.229344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.229744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.229994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.230879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:38.231199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.233109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.246546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 576/1148] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:38.253885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.263621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb205c6e-0004-411a-bc19-7d9f1fb98b05 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.268738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.269558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.269920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.270286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.278389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.280439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.294595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:38:38.295771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 573/1149] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:38.302242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.313805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6931ae1-3dbd-4b27-a464-329236c1ef33 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.318613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.319267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.319551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.319826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.320687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:38.320994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.322850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.343697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 577/1150] 10.222.0.48 () {56 vars in 1164 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:38.350648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.362386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ff319-87d0-4d20-be2b-a6439b67d516 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.367849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.368491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.368777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.369054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.376845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.378606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.388296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 574/1151] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:38.394882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.405127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c785fd-b0a5-4acc-8463-cdbe1e4d965f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.411229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.412260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.412678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.413097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.424088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.425943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.442442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:38.443606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 578/1152] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:38.450023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.459164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b02bf-9fff-4d9a-a068-31c645e2f009 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.464493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.465138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.465446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.465723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.466451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:38.466757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.468325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.481128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 575/1153] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:38.487362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.498637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6996a9-a7bb-4a7a-8f82-f37073823dfa admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.503420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.504256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.504495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.504779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.511694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.513727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.526903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:38.528178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 579/1154] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:38.534763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.545583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7b3f4-825c-4c62-85a3-97c2ff93c6f7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.550475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6a901-44c1-463d-b3f3-db668ca242cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.551206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a901-44c1-463d-b3f3-db668ca242cc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.551491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a901-44c1-463d-b3f3-db668ca242cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.551809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6a901-44c1-463d-b3f3-db668ca242cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.552687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a901-44c1-463d-b3f3-db668ca242cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:38.552998 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a901-44c1-463d-b3f3-db668ca242cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.555150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6a901-44c1-463d-b3f3-db668ca242cc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.567187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 576/1155] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:38.573916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:38.586560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be8df9-bb03-4850-9a34-f70517a95781 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:38.591783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b2d72-3075-464e-8023-8ec220acc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:38.592502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2d72-3075-464e-8023-8ec220acc8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:38.592829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2d72-3075-464e-8023-8ec220acc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:38.593171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b2d72-3075-464e-8023-8ec220acc8d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:38.594167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2d72-3075-464e-8023-8ec220acc8d7 admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=32dbbc4af72f4d11a9b1876dba8e886f) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:38.594529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2d72-3075-464e-8023-8ec220acc8d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:38.596571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b2d72-3075-464e-8023-8ec220acc8d7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:38.603489 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 580/1156] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:38 2021] GET /identity/v3/role_assignments?user.id=32dbbc4af72f4d11a9b1876dba8e886f&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:40.949424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f6029-3f9d-40e2-bdee-1b81e6ba3fda None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.949960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f6029-3f9d-40e2-bdee-1b81e6ba3fda None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.949960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f6029-3f9d-40e2-bdee-1b81e6ba3fda None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.951683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 577/1157] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:40.957847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b37d-f53c-4e96-a4dc-c9e646da3e74 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:40.958281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b37d-f53c-4e96-a4dc-c9e646da3e74 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:40.958675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226b37d-f53c-4e96-a4dc-c9e646da3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:40.979278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f226b37d-f53c-4e96-a4dc-c9e646da3e74 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:40.980702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f226b37d-f53c-4e96-a4dc-c9e646da3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:40.993455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 581/1158] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:38:41.013873 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f6029-3f9d-40e2-bdee-1b81e6ba3fda None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.030882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f6029-3f9d-40e2-bdee-1b81e6ba3fda None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.037113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.037934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.038420 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.038759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.052667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:41.059798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:41.061247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 578/1159] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:41.069534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b37d-f53c-4e96-a4dc-c9e646da3e74 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.082617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226b37d-f53c-4e96-a4dc-c9e646da3e74 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.089575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.090441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.090786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.091081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.092058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:41.092469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.094433 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.103747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 582/1160] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:41.110721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.121618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5b5c0-d9f7-4e39-b2a6-5ac725d0c74b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.126426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.127190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.127471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.127739 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.138448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.140278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.160118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:41.161914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 579/1161] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:41.168914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.179377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabc078-05c3-4ac1-97f8-9de654c2e8f7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.184498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.185195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.185532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.185820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.186560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:41.186875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.188477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.201754 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 583/1162] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:41.208131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.219163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc2e3-746d-4039-a4a7-a45a27f7f2f0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.223810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.224587 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.224875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.225148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.232416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.234470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.249360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:38:41.250592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 580/1163] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:41.257021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.267534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff16e2-f6fc-4251-87aa-d58985e2fa63 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.272481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.273685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.273974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.274247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.275112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:41.275418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.277240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.294819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 584/1164] 10.222.0.48 () {56 vars in 1164 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:38:41.301190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.311976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2057-f1d4-4a9c-9706-de2d4fe76f6c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.317717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.318669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.319005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.319435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.331369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.333203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.351289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:41.352553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 581/1165] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:41.359601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.374577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37532487-06fd-4e39-8cb5-6ef515cf3d72 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.381516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.383337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.384056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.384706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.385818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:41.386907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.390956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.406401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 585/1166] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:41.414181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.424999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d2f6-5c3e-41d0-a263-f217444ec9bc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.431307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.432254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.432558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.432856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.440862 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.442881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.457804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:41.459233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 582/1167] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 16:38:41.466905 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.478417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd95e38-0201-4c98-8ac2-52396b02188d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.483467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfea52-56af-401b-9325-8bf3890a9716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.484149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfea52-56af-401b-9325-8bf3890a9716 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.484437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfea52-56af-401b-9325-8bf3890a9716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.484716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfea52-56af-401b-9325-8bf3890a9716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.485549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfea52-56af-401b-9325-8bf3890a9716 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:41.485870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfea52-56af-401b-9325-8bf3890a9716 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.487697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfea52-56af-401b-9325-8bf3890a9716 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.501196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 586/1168] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:41.509130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:41.520060 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4a6fb-eda2-4c44-bb38-19e2adb3fb61 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:41.525033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f63ef4-46ec-4c55-a743-220ec2546feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:41.526069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63ef4-46ec-4c55-a743-220ec2546feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:41.526357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63ef4-46ec-4c55-a743-220ec2546feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:41.526667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f63ef4-46ec-4c55-a743-220ec2546feb admin admin] PATH_INFO: `/v3/projects/f119466674a340b69452f507c88cfdf6/users/32dbbc4af72f4d11a9b1876dba8e886f/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:41.528977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f63ef4-46ec-4c55-a743-220ec2546feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119466674a340b69452f507c88cfdf6, user_id=32dbbc4af72f4d11a9b1876dba8e886f, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:41.532210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f63ef4-46ec-4c55-a743-220ec2546feb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:41.546042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 583/1169] 10.222.0.48 () {58 vars in 1460 bytes} [Tue Oct 12 16:38:41 2021] PUT /identity/v3/projects/f119466674a340b69452f507c88cfdf6/users/32dbbc4af72f4d11a9b1876dba8e886f/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:38:43.809210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d339-b454-467a-bfde-3c3bfa2716b5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:43.809774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d339-b454-467a-bfde-3c3bfa2716b5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:43.809894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d339-b454-467a-bfde-3c3bfa2716b5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:43.811651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 587/1170] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:43.817534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ee9b-9b19-4cea-89ec-9deb62d5b559 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:43.817929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ee9b-9b19-4cea-89ec-9deb62d5b559 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:43.818085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ee9b-9b19-4cea-89ec-9deb62d5b559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:43.835063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f733ee9b-9b19-4cea-89ec-9deb62d5b559 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:43.836736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f733ee9b-9b19-4cea-89ec-9deb62d5b559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:43.890803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:43.915762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d339-b454-467a-bfde-3c3bfa2716b5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:43.927618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d339-b454-467a-bfde-3c3bfa2716b5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:43.932005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:43.932765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:43.933052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:43.933331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:43.943307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 16:38:43.950586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 16:38:43.959419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 588/1172] 10.222.0.48 () {56 vars in 1117 bytes} [Tue Oct 12 16:38:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:43.966876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733ee9b-9b19-4cea-89ec-9deb62d5b559 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:43.975597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733ee9b-9b19-4cea-89ec-9deb62d5b559 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:43.981129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:43.982180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:43.982826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:43.983324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:43.984275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:43.984582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:43.986196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:43.995264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 585/1173] 10.222.0.48 () {56 vars in 1120 bytes} [Tue Oct 12 16:38:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:44.002337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.022713 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe2633-e742-4d31-9c7f-b5a4ca712653 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.030120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.030893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.031179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.031454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.043268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.045155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.062025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:44.063067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 589/1174] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:44.071119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.081338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e231d9b-f1d9-4664-92b4-4edda9e40c4f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.086875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.087523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.087811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.088092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.088821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:44.089130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.090764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.102370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 586/1175] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:44.108339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.117804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79204104-174b-4b96-85c5-ae145d37fdad admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.122313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.123081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.123369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.123649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.130684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.133205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.146740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 16:38:44.147862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 590/1176] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:44.154809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.164626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28cef8-a062-4e11-b810-400ef589f6bf admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.169349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.170028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.170310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.170585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.171417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:44.171725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.173572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.190045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 587/1177] 10.222.0.48 () {56 vars in 1164 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:44.196766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.206270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550d369-0714-417f-a72b-6a91ea8bb943 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.211564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.212186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.212472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.212750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.220613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.222387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.231846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 591/1178] 10.222.0.48 () {58 vars in 1324 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:38:44.238223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.248348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f8538-41a6-4542-81a2-ccaf4c8f9081 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.252810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.253608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.253892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.254229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.264161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.265987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.283042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 16:38:44.284213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 588/1179] 10.222.0.48 () {56 vars in 1129 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:44.291119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.299884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376f9aa-0541-451f-8187-8f23429226cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.305317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.306015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.306390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.306577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.307310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:44.307618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.309201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.321259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 592/1180] 10.222.0.48 () {56 vars in 1130 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:44.327577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.338094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71de860-46d8-45ba-974f-6943457d55c2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.342755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.343594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.343946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.344290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.351965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.354009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.367257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING keystone.server.flask.application [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 16:38:44.374027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 589/1181] 10.222.0.48 () {56 vars in 1132 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:44.375294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.384946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e794b-fc29-4de5-a549-f1541754bbe4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.389626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3933a-2dc4-4bd4-b8e0-0e043c9eccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.390267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3933a-2dc4-4bd4-b8e0-0e043c9eccaf admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.390552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3933a-2dc4-4bd4-b8e0-0e043c9eccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.390832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3933a-2dc4-4bd4-b8e0-0e043c9eccaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.391623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3933a-2dc4-4bd4-b8e0-0e043c9eccaf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:44.391934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3933a-2dc4-4bd4-b8e0-0e043c9eccaf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.393797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3933a-2dc4-4bd4-b8e0-0e043c9eccaf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.406912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 593/1182] 10.222.0.48 () {56 vars in 1169 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:44.413434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:44.424445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b0abe-f710-41b7-8998-ee9ed8701ce8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:44.429018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85837d96-8cab-4298-aeec-c711c6f8c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:44.429687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837d96-8cab-4298-aeec-c711c6f8c07b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:44.429972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837d96-8cab-4298-aeec-c711c6f8c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:44.430250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837d96-8cab-4298-aeec-c711c6f8c07b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:44.431117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837d96-8cab-4298-aeec-c711c6f8c07b admin admin] RBAC: Adding query filter params (role.id=3a471e61998d4a34b97fef6a8964c88b, scope.project.id=f119466674a340b69452f507c88cfdf6, user.id=32dbbc4af72f4d11a9b1876dba8e886f) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:44.431458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837d96-8cab-4298-aeec-c711c6f8c07b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:44.433260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837d96-8cab-4298-aeec-c711c6f8c07b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:44.439372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 590/1183] 10.222.0.48 () {56 vars in 1395 bytes} [Tue Oct 12 16:38:44 2021] GET /identity/v3/role_assignments?user.id=32dbbc4af72f4d11a9b1876dba8e886f&scope.project.id=f119466674a340b69452f507c88cfdf6&role.id=3a471e61998d4a34b97fef6a8964c88b => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:46.727223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad86b63-8595-4321-b32b-92e5e73ae148 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:46.727755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad86b63-8595-4321-b32b-92e5e73ae148 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:46.727755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad86b63-8595-4321-b32b-92e5e73ae148 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:46.729587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 594/1184] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:46.735461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51aef3-181a-4548-8653-ec67c3d09953 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:46.735861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51aef3-181a-4548-8653-ec67c3d09953 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:46.736019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51aef3-181a-4548-8653-ec67c3d09953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:46.753106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5b51aef3-181a-4548-8653-ec67c3d09953 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:46.754333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5b51aef3-181a-4548-8653-ec67c3d09953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:46.762472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 591/1185] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:46.785134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad86b63-8595-4321-b32b-92e5e73ae148 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:46.796849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad86b63-8595-4321-b32b-92e5e73ae148 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:46.801218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:46.802038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:46.802321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:46.802597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:46.803248 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:46.805343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:46.815874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:38:46.816954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 595/1186] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:38:46 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:46.823814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51aef3-181a-4548-8653-ec67c3d09953 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:46.832642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51aef3-181a-4548-8653-ec67c3d09953 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:46.837476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be5760-11da-49ac-a1c3-da19795275bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:46.838117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be5760-11da-49ac-a1c3-da19795275bf admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:46.838403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be5760-11da-49ac-a1c3-da19795275bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:46.838684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be5760-11da-49ac-a1c3-da19795275bf admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:46.839395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be5760-11da-49ac-a1c3-da19795275bf admin admin] RBAC: Adding query filter params (name=placement) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:46.839704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be5760-11da-49ac-a1c3-da19795275bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:46.841272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be5760-11da-49ac-a1c3-da19795275bf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:46.845901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 592/1187] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 12 16:38:46 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:46.851796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:46.860959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05f285-0b6e-4ea6-a27f-05f0e1b32201 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:46.865448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbadc77-4e7e-408e-aa41-a15556c51246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:46.866068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbadc77-4e7e-408e-aa41-a15556c51246 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:46.866354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbadc77-4e7e-408e-aa41-a15556c51246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:46.866634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbadc77-4e7e-408e-aa41-a15556c51246 admin admin] PATH_INFO: `/v3/services` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:46.867851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbadc77-4e7e-408e-aa41-a15556c51246 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:46.868154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbadc77-4e7e-408e-aa41-a15556c51246 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:46.869710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbadc77-4e7e-408e-aa41-a15556c51246 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:46.873902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 596/1188] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 12 16:38:46 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:49.097538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639669-30c0-4394-a02e-39236017f80a None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:49.098066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639669-30c0-4394-a02e-39236017f80a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:49.098182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69639669-30c0-4394-a02e-39236017f80a None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:49.099884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 593/1189] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:49.105927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c8e-47cf-49fc-a202-6422750ac849 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:49.106386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c8e-47cf-49fc-a202-6422750ac849 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:49.106477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2307c8e-47cf-49fc-a202-6422750ac849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:49.124920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a2307c8e-47cf-49fc-a202-6422750ac849 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:49.126183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a2307c8e-47cf-49fc-a202-6422750ac849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:49.134653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 597/1190] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:49.158007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69639669-30c0-4394-a02e-39236017f80a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:49.170376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69639669-30c0-4394-a02e-39236017f80a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:49.174921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56c635-c53f-460d-884d-5cede39dc764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:49.175573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56c635-c53f-460d-884d-5cede39dc764 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:49.175858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56c635-c53f-460d-884d-5cede39dc764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:49.176135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56c635-c53f-460d-884d-5cede39dc764 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:49.176863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56c635-c53f-460d-884d-5cede39dc764 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:49.178465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56c635-c53f-460d-884d-5cede39dc764 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:49.191466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 594/1191] 10.222.0.48 () {60 vars in 1162 bytes} [Tue Oct 12 16:38:49 2021] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:38:51.429200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6129c-e4b7-4dc5-9163-6e96074f2311 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:51.429744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6129c-e4b7-4dc5-9163-6e96074f2311 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:51.429744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6129c-e4b7-4dc5-9163-6e96074f2311 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:51.431510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 598/1192] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:51.437348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b4e9-a2a2-44d5-b20b-bd5633ab4d10 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:51.437870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b4e9-a2a2-44d5-b20b-bd5633ab4d10 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:51.437982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b4e9-a2a2-44d5-b20b-bd5633ab4d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:51.455644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2f56b4e9-a2a2-44d5-b20b-bd5633ab4d10 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:51.456832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2f56b4e9-a2a2-44d5-b20b-bd5633ab4d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:51.473925 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 595/1193] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:51.498036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6129c-e4b7-4dc5-9163-6e96074f2311 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:51.510512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6129c-e4b7-4dc5-9163-6e96074f2311 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:51.514847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:51.515619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:51.515903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:51.516179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:51.516849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:51.518461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:51.529754 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:38:51.530858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 599/1194] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:38:51 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:51.537120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b4e9-a2a2-44d5-b20b-bd5633ab4d10 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:51.545871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b4e9-a2a2-44d5-b20b-bd5633ab4d10 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:51.550685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:51.551324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:51.551606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:51.551880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:51.552592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:51.552894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:51.554582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:51.559554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 596/1195] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 12 16:38:51 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:51.565776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:51.575608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4532b-e28b-46e1-abb0-5585d5e998f6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:51.580109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae7631-0dad-4181-872d-a860d0b62763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:51.580734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7631-0dad-4181-872d-a860d0b62763 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:51.581019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7631-0dad-4181-872d-a860d0b62763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:51.581299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae7631-0dad-4181-872d-a860d0b62763 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:51.582113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7631-0dad-4181-872d-a860d0b62763 admin admin] RBAC: Adding query filter params (interface=public, service_id=795f5534d41343a18ecd24f545db5d40, region_id=RegionOne) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:51.582426 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7631-0dad-4181-872d-a860d0b62763 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:51.584229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae7631-0dad-4181-872d-a860d0b62763 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:51.589650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 600/1196] 10.222.0.48 () {56 vars in 1272 bytes} [Tue Oct 12 16:38:51 2021] GET /identity/v3/endpoints?service_id=795f5534d41343a18ecd24f545db5d40&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:51.595615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:51.605043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfffd6-610a-4d22-b307-17744043a96a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:51.610012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5fbbd-c6ef-4e92-9542-3c0c33a1a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:51.610653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fbbd-c6ef-4e92-9542-3c0c33a1a4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:51.610935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fbbd-c6ef-4e92-9542-3c0c33a1a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:51.611210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fbbd-c6ef-4e92-9542-3c0c33a1a4a3 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:51.611894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5fbbd-c6ef-4e92-9542-3c0c33a1a4a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:51.613491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5fbbd-c6ef-4e92-9542-3c0c33a1a4a3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:51.620181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 597/1197] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:38:51 2021] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:38:53.868336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4693-4415-4bc7-8a38-604bb5a27bfb None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:53.869034 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4693-4415-4bc7-8a38-604bb5a27bfb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:53.869034 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c4693-4415-4bc7-8a38-604bb5a27bfb None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:53.870823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 601/1198] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:38:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:38:53.877139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80154a-2574-4734-b963-eb1a9e7161b6 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:53.877596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80154a-2574-4734-b963-eb1a9e7161b6 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:53.877783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80154a-2574-4734-b963-eb1a9e7161b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:53.895787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0c80154a-2574-4734-b963-eb1a9e7161b6 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:38:53.896982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0c80154a-2574-4734-b963-eb1a9e7161b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:38:53.905224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 598/1199] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:38:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:38:53.929982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4693-4415-4bc7-8a38-604bb5a27bfb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:53.942050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c4693-4415-4bc7-8a38-604bb5a27bfb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:53.946452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:53.947226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:53.947511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:53.947790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:53.948479 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:53.950112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:53.961118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING keystone.server.flask.application [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 16:38:53.962256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 602/1200] 10.222.0.48 () {56 vars in 1138 bytes} [Tue Oct 12 16:38:53 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 16:38:53.969055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80154a-2574-4734-b963-eb1a9e7161b6 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:53.978690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80154a-2574-4734-b963-eb1a9e7161b6 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:53.983242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b44e22-30c6-437c-b5cf-d96a7db3b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:53.983885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44e22-30c6-437c-b5cf-d96a7db3b5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:53.984169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44e22-30c6-437c-b5cf-d96a7db3b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:53.984447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b44e22-30c6-437c-b5cf-d96a7db3b5c4 admin admin] PATH_INFO: `/v3/services` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:53.985155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b44e22-30c6-437c-b5cf-d96a7db3b5c4 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:38:53.985492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b44e22-30c6-437c-b5cf-d96a7db3b5c4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:53.987072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b44e22-30c6-437c-b5cf-d96a7db3b5c4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:53.992996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 599/1201] 10.222.0.48 () {56 vars in 1137 bytes} [Tue Oct 12 16:38:53 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:38:54.000871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:38:54.012840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e651b3-9991-42ca-a1cd-d335bc03f51f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:38:54.018924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09e84e-98ec-485e-8964-caa9bde5e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:38:54.019604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e84e-98ec-485e-8964-caa9bde5e82a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:38:54.019998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e84e-98ec-485e-8964-caa9bde5e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:38:54.020365 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09e84e-98ec-485e-8964-caa9bde5e82a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:38:54.021308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09e84e-98ec-485e-8964-caa9bde5e82a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:38:54.023208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09e84e-98ec-485e-8964-caa9bde5e82a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:38:54.055266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 603/1202] 10.222.0.48 () {60 vars in 1165 bytes} [Tue Oct 12 16:38:53 2021] POST /identity/v3/endpoints => generated 331 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:39:58.431049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1bd07-8952-4b02-91b9-95607d1c3fb9 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.432275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1bd07-8952-4b02-91b9-95607d1c3fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.432706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1bd07-8952-4b02-91b9-95607d1c3fb9 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.442909 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e695f4-4ec9-46d8-883e-e05f3fd969c4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:58.443815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e695f4-4ec9-46d8-883e-e05f3fd969c4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:58.444287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e695f4-4ec9-46d8-883e-e05f3fd969c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:58.448218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 600/1203] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:39:58 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:39:58.644588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-95e695f4-4ec9-46d8-883e-e05f3fd969c4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:39:58.646648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-95e695f4-4ec9-46d8-883e-e05f3fd969c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:39:58.820510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 604/1204] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:39:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:39:58.855482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1bd07-8952-4b02-91b9-95607d1c3fb9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:39:58.857269 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-49f1bd07-8952-4b02-91b9-95607d1c3fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:39:59.061687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1bd07-8952-4b02-91b9-95607d1c3fb9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:39:59.187487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f98b74-8e87-4f4a-92eb-017a53e55c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:39:59.188866 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f98b74-8e87-4f4a-92eb-017a53e55c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:39:59.189525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f98b74-8e87-4f4a-92eb-017a53e55c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:39:59.190129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f98b74-8e87-4f4a-92eb-017a53e55c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:39:59.191270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f98b74-8e87-4f4a-92eb-017a53e55c50 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:39:59.193567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f98b74-8e87-4f4a-92eb-017a53e55c50 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:39:59.230474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 601/1205] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:39:58 2021] GET /identity/v3/projects => generated 2553 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:40:01.651395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cc9d7-98ea-43d0-ad26-ae5905539b02 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.651941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cc9d7-98ea-43d0-ad26-ae5905539b02 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.651941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cc9d7-98ea-43d0-ad26-ae5905539b02 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.653775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 605/1206] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:01.659742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24037030-0576-430b-8554-ed41342d57da None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.660171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24037030-0576-430b-8554-ed41342d57da None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.660308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24037030-0576-430b-8554-ed41342d57da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.743618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-24037030-0576-430b-8554-ed41342d57da None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:01.744946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-24037030-0576-430b-8554-ed41342d57da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:01.839295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 602/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:01.893931 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e152b-575b-4596-998e-46b5e9bf77a9 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.894218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e152b-575b-4596-998e-46b5e9bf77a9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.894531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e152b-575b-4596-998e-46b5e9bf77a9 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.896399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 606/1208] 10.222.0.48 () {54 vars in 963 bytes} [Tue Oct 12 16:40:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:01.904155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d220-1852-4f24-8e6f-3fa06d842547 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:01.904375 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d220-1852-4f24-8e6f-3fa06d842547 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:01.904698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d220-1852-4f24-8e6f-3fa06d842547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:01.985728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1e05d220-1852-4f24-8e6f-3fa06d842547 None None] MFA Rules not processed for user `671f4f6ff7d84739aecf74e53bb1aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:01.986959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1e05d220-1852-4f24-8e6f-3fa06d842547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:02.066516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 603/1209] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Oct 12 16:40:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:02.076796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e152b-575b-4596-998e-46b5e9bf77a9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:02.078394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-119e152b-575b-4596-998e-46b5e9bf77a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:02.202366 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e152b-575b-4596-998e-46b5e9bf77a9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:02.288614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2565d53-3b54-4e08-8194-b3254f471968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:02.289271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2565d53-3b54-4e08-8194-b3254f471968 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:02.289591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2565d53-3b54-4e08-8194-b3254f471968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:02.289870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2565d53-3b54-4e08-8194-b3254f471968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:02.291581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b2565d53-3b54-4e08-8194-b3254f471968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:02.424695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2565d53-3b54-4e08-8194-b3254f471968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:02.426174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2565d53-3b54-4e08-8194-b3254f471968 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:02.445392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 607/1210] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:05.052956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caf8f0-477f-40fa-874f-bfa89bac7c94 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:05.053978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caf8f0-477f-40fa-874f-bfa89bac7c94 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:05.054148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caf8f0-477f-40fa-874f-bfa89bac7c94 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:05.055953 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 604/1211] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:05.062419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f31f2-c013-4ab5-a276-5a16cb98e372 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:05.062866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f31f2-c013-4ab5-a276-5a16cb98e372 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:05.062960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f31f2-c013-4ab5-a276-5a16cb98e372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:05.127842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-905f31f2-c013-4ab5-a276-5a16cb98e372 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:05.133084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-905f31f2-c013-4ab5-a276-5a16cb98e372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:05.243219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 608/1212] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:05.296346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5c96f-f31c-4bc2-b380-fb6eaec999d3 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:05.296859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5c96f-f31c-4bc2-b380-fb6eaec999d3 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:05.297365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5c96f-f31c-4bc2-b380-fb6eaec999d3 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:05.300329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 605/1213] 10.222.0.48 () {54 vars in 963 bytes} [Tue Oct 12 16:40:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:05.307017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff316a-f99c-4063-89f1-c666a4760ffe None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:05.307305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff316a-f99c-4063-89f1-c666a4760ffe None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:05.307596 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff316a-f99c-4063-89f1-c666a4760ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:05.386303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ffff316a-f99c-4063-89f1-c666a4760ffe None None] MFA Rules not processed for user `671f4f6ff7d84739aecf74e53bb1aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:05.387750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ffff316a-f99c-4063-89f1-c666a4760ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:05.468131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 609/1214] 10.222.0.48 () {58 vars in 1060 bytes} [Tue Oct 12 16:40:05 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:05.478567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5c96f-f31c-4bc2-b380-fb6eaec999d3 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:05.480168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7dd5c96f-f31c-4bc2-b380-fb6eaec999d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:05.580132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5c96f-f31c-4bc2-b380-fb6eaec999d3 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:05.650802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da0450-4d7d-4f94-a149-e34feccca293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:05.651439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0450-4d7d-4f94-a149-e34feccca293 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:05.651724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0450-4d7d-4f94-a149-e34feccca293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:05.652000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da0450-4d7d-4f94-a149-e34feccca293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:05.653650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-16da0450-4d7d-4f94-a149-e34feccca293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:05.762205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da0450-4d7d-4f94-a149-e34feccca293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:05.763738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da0450-4d7d-4f94-a149-e34feccca293 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:05.782524 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 606/1215] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:08.574253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad64b-a571-41f4-9496-7a497872cc6a None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:08.574782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad64b-a571-41f4-9496-7a497872cc6a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:08.574875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ad64b-a571-41f4-9496-7a497872cc6a None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:08.576591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 610/1216] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:08.582396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:08.582826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:08.582967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:08.648203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:08.649433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:08.747546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 607/1217] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:08.782956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ad64b-a571-41f4-9496-7a497872cc6a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:08.784462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f02ad64b-a571-41f4-9496-7a497872cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:08.901857 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ad64b-a571-41f4-9496-7a497872cc6a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:08.990446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2ba8c-ff09-4860-a1fa-69cfcb8135d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:08.991899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2ba8c-ff09-4860-a1fa-69cfcb8135d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:08.992186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2ba8c-ff09-4860-a1fa-69cfcb8135d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:08.992460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2ba8c-ff09-4860-a1fa-69cfcb8135d5 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:09.002138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2ba8c-ff09-4860-a1fa-69cfcb8135d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:09.004206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2ba8c-ff09-4860-a1fa-69cfcb8135d5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:09.005959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 611/1218] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:08 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:09.018431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:09.019619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:09.111077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e656a-4b28-4a5f-aa53-a2d5099a1148 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:09.180184 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cafe13-d1a5-45a6-96f3-ad8f993ee947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:09.180768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cafe13-d1a5-45a6-96f3-ad8f993ee947 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:09.181053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cafe13-d1a5-45a6-96f3-ad8f993ee947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:09.181333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cafe13-d1a5-45a6-96f3-ad8f993ee947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:09.183001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-09cafe13-d1a5-45a6-96f3-ad8f993ee947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:09.285632 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cafe13-d1a5-45a6-96f3-ad8f993ee947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:09.287060 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cafe13-d1a5-45a6-96f3-ad8f993ee947 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:09.304684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 608/1219] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:12.266660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb04be8-f394-4862-ab15-7d7df4388c4c None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.267171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb04be8-f394-4862-ab15-7d7df4388c4c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.267171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb04be8-f394-4862-ab15-7d7df4388c4c None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.268938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 612/1220] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:40:12.275029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.275472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.275605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.340037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:12.341268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:12.432174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 609/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:12.467358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb04be8-f394-4862-ab15-7d7df4388c4c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:12.468861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bdb04be8-f394-4862-ab15-7d7df4388c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:12.587032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb04be8-f394-4862-ab15-7d7df4388c4c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:12.679628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a850e-2e3a-43b7-a92b-986c17bec9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:12.680462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a850e-2e3a-43b7-a92b-986c17bec9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.680745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a850e-2e3a-43b7-a92b-986c17bec9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.681017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a850e-2e3a-43b7-a92b-986c17bec9b8 admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.690330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a850e-2e3a-43b7-a92b-986c17bec9b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:12.692366 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a850e-2e3a-43b7-a92b-986c17bec9b8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:12.694120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 613/1222] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:12 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:12.706520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:12.707703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:12.792716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371f85e-b980-41ea-b8e2-070d6a07987e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:12.860860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf27d4-65db-47cf-904e-45c2fa9477a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:12.861458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf27d4-65db-47cf-904e-45c2fa9477a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:12.861740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf27d4-65db-47cf-904e-45c2fa9477a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:12.862016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf27d4-65db-47cf-904e-45c2fa9477a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:12.863613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e9cf27d4-65db-47cf-904e-45c2fa9477a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:12.964813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf27d4-65db-47cf-904e-45c2fa9477a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:12.966272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf27d4-65db-47cf-904e-45c2fa9477a9 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:12.983892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 610/1223] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:15.897248 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3861f4-a849-4fd9-a33e-8156530d6ef4 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:15.897860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3861f4-a849-4fd9-a33e-8156530d6ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:15.897860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3861f4-a849-4fd9-a33e-8156530d6ef4 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:15.899724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 614/1224] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:15.906556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db77bd-ce15-4536-bf88-cd0f514a6aad None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:15.907140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db77bd-ce15-4536-bf88-cd0f514a6aad None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:15.907140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db77bd-ce15-4536-bf88-cd0f514a6aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:15.974588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e9db77bd-ce15-4536-bf88-cd0f514a6aad None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:15.975812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e9db77bd-ce15-4536-bf88-cd0f514a6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:16.075658 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 611/1225] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:16.112829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3861f4-a849-4fd9-a33e-8156530d6ef4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:16.114507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fc3861f4-a849-4fd9-a33e-8156530d6ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:16.218315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3861f4-a849-4fd9-a33e-8156530d6ef4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:16.292312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c005e39-aab4-4274-9e51-e52d768fdc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:16.292959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005e39-aab4-4274-9e51-e52d768fdc3c service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:16.293247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005e39-aab4-4274-9e51-e52d768fdc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:16.293572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c005e39-aab4-4274-9e51-e52d768fdc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:16.295208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2c005e39-aab4-4274-9e51-e52d768fdc3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:16.403837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c005e39-aab4-4274-9e51-e52d768fdc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:16.405274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c005e39-aab4-4274-9e51-e52d768fdc3c service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:16.423914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 615/1226] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:18.782920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c73e9e-030d-40d7-a5cf-95dd18031814 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:18.783473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c73e9e-030d-40d7-a5cf-95dd18031814 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:18.783473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c73e9e-030d-40d7-a5cf-95dd18031814 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:18.785295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 612/1227] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:18.791360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3b32-9390-47db-9e16-09c8a76c316b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:18.791917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3b32-9390-47db-9e16-09c8a76c316b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:18.791917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3b32-9390-47db-9e16-09c8a76c316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:18.855272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f0bb3b32-9390-47db-9e16-09c8a76c316b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:18.856527 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f0bb3b32-9390-47db-9e16-09c8a76c316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:18.953460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 616/1228] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:18.991907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c73e9e-030d-40d7-a5cf-95dd18031814 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:18.993577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-25c73e9e-030d-40d7-a5cf-95dd18031814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:19.098580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c73e9e-030d-40d7-a5cf-95dd18031814 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:19.172664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aca99-fdf7-4e81-a482-63270a848f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:19.173325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aca99-fdf7-4e81-a482-63270a848f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:19.173656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aca99-fdf7-4e81-a482-63270a848f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:19.173910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aca99-fdf7-4e81-a482-63270a848f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:19.175637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-194aca99-fdf7-4e81-a482-63270a848f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:19.284551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aca99-fdf7-4e81-a482-63270a848f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:19.286088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aca99-fdf7-4e81-a482-63270a848f6f service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:19.306025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 613/1229] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:21.634122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d079c8-12f9-4315-8be9-87d277128821 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:21.634639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d079c8-12f9-4315-8be9-87d277128821 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:21.634758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d079c8-12f9-4315-8be9-87d277128821 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:21.636485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 617/1230] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:21.642383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:21.642782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:21.642945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:21.712444 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:21.713733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:21.809170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 614/1231] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:21.843504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d079c8-12f9-4315-8be9-87d277128821 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:21.845029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c9d079c8-12f9-4315-8be9-87d277128821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:21.965940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d079c8-12f9-4315-8be9-87d277128821 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:22.057449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d4b02-b105-46c3-bb02-e218b8d7921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:22.058300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4b02-b105-46c3-bb02-e218b8d7921b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:22.058587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4b02-b105-46c3-bb02-e218b8d7921b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:22.058867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d4b02-b105-46c3-bb02-e218b8d7921b admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:22.068307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d4b02-b105-46c3-bb02-e218b8d7921b admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:22.070429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d4b02-b105-46c3-bb02-e218b8d7921b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:22.072306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 618/1232] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:40:21 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:40:22.085089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:22.086600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:22.173718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabf5c6-4d5d-4ef9-a82a-e1bb1b9a3a83 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:22.246793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef890f-0a2c-4793-900e-45744fffbcd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:22.247456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef890f-0a2c-4793-900e-45744fffbcd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:22.247740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef890f-0a2c-4793-900e-45744fffbcd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:22.248015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef890f-0a2c-4793-900e-45744fffbcd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:22.249680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-14ef890f-0a2c-4793-900e-45744fffbcd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:22.363042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef890f-0a2c-4793-900e-45744fffbcd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:22.364478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef890f-0a2c-4793-900e-45744fffbcd9 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:22.382328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 615/1233] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:25.188691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ce9bb-c0fa-4110-a9c1-f05d3cc054b3 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:25.189359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ce9bb-c0fa-4110-a9c1-f05d3cc054b3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:25.189359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ce9bb-c0fa-4110-a9c1-f05d3cc054b3 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:25.191073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 619/1234] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:25.198154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa044-94cf-4786-8c04-5a9470f4cbe1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:25.198711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa044-94cf-4786-8c04-5a9470f4cbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:25.198711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa044-94cf-4786-8c04-5a9470f4cbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:25.275903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3adfa044-94cf-4786-8c04-5a9470f4cbe1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:25.277054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3adfa044-94cf-4786-8c04-5a9470f4cbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:25.375357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 616/1235] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:25.412197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ce9bb-c0fa-4110-a9c1-f05d3cc054b3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:25.414305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f70ce9bb-c0fa-4110-a9c1-f05d3cc054b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:25.529015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ce9bb-c0fa-4110-a9c1-f05d3cc054b3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:25.607611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532a0f7-1472-4212-88ea-b89561150d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:25.608259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532a0f7-1472-4212-88ea-b89561150d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:25.608542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532a0f7-1472-4212-88ea-b89561150d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:25.608815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532a0f7-1472-4212-88ea-b89561150d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:25.610501 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9532a0f7-1472-4212-88ea-b89561150d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:25.738279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532a0f7-1472-4212-88ea-b89561150d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:25.739729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532a0f7-1472-4212-88ea-b89561150d5c service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:25.761466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 620/1236] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:28.083122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3096c1-2749-4bf9-ba67-4157ef8e5dbd None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:28.083672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3096c1-2749-4bf9-ba67-4157ef8e5dbd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:28.083672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3096c1-2749-4bf9-ba67-4157ef8e5dbd None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:28.086311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 617/1237] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:28.092446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fed35-7c91-4fa8-a47c-8077f8180c5e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:28.092970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fed35-7c91-4fa8-a47c-8077f8180c5e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:28.093074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fed35-7c91-4fa8-a47c-8077f8180c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:28.159099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ac0fed35-7c91-4fa8-a47c-8077f8180c5e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:28.160283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ac0fed35-7c91-4fa8-a47c-8077f8180c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:28.251729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 621/1238] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:28.295216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3096c1-2749-4bf9-ba67-4157ef8e5dbd None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:28.296746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fc3096c1-2749-4bf9-ba67-4157ef8e5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:28.397472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3096c1-2749-4bf9-ba67-4157ef8e5dbd None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:28.466701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e2794-aa6d-48fb-9bad-102b4a7b6136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:28.467345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e2794-aa6d-48fb-9bad-102b4a7b6136 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:28.467629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e2794-aa6d-48fb-9bad-102b4a7b6136 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:28.467905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e2794-aa6d-48fb-9bad-102b4a7b6136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:28.469555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-941e2794-aa6d-48fb-9bad-102b4a7b6136 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:28.574484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e2794-aa6d-48fb-9bad-102b4a7b6136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:28.575620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e2794-aa6d-48fb-9bad-102b4a7b6136 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:28.592986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 618/1239] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:31.180140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ee6fd-e581-41db-881e-bde1b0871866 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.180719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ee6fd-e581-41db-881e-bde1b0871866 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.180719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ee6fd-e581-41db-881e-bde1b0871866 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.182519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 622/1240] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:31.188535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b40f1-14e5-4b11-b333-37aea53e9d8b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.188978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b40f1-14e5-4b11-b333-37aea53e9d8b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.189084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b40f1-14e5-4b11-b333-37aea53e9d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.256444 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e14b40f1-14e5-4b11-b333-37aea53e9d8b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:31.257579 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e14b40f1-14e5-4b11-b333-37aea53e9d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:31.354335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 619/1241] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:31.392165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ee6fd-e581-41db-881e-bde1b0871866 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:31.394249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-997ee6fd-e581-41db-881e-bde1b0871866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:31.484244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ee6fd-e581-41db-881e-bde1b0871866 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:31.487740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b1cb-4cf2-4d0f-9a54-f77ca93acaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:31.488375 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b1cb-4cf2-4d0f-9a54-f77ca93acaed service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:31.488667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b1cb-4cf2-4d0f-9a54-f77ca93acaed service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:31.488941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b1cb-4cf2-4d0f-9a54-f77ca93acaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:31.498143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b1cb-4cf2-4d0f-9a54-f77ca93acaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:31.499553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b1cb-4cf2-4d0f-9a54-f77ca93acaed service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:31.508490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 623/1242] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:35.706152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb2c2-aa06-4198-8080-32bb67da6d62 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:35.706677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb2c2-aa06-4198-8080-32bb67da6d62 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:35.706677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccb2c2-aa06-4198-8080-32bb67da6d62 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:35.708402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 620/1243] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:35.715315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a56e1-43c9-4395-97fb-60644f8c4113 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:35.715807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a56e1-43c9-4395-97fb-60644f8c4113 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:35.715913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a56e1-43c9-4395-97fb-60644f8c4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:35.734061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-695a56e1-43c9-4395-97fb-60644f8c4113 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:35.735239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-695a56e1-43c9-4395-97fb-60644f8c4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:35.743501 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 624/1244] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:35.784646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb2c2-aa06-4198-8080-32bb67da6d62 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:35.795394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccb2c2-aa06-4198-8080-32bb67da6d62 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:35.798944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687cfe1-08eb-462c-98dd-4cd6c36ba851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:35.799578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687cfe1-08eb-462c-98dd-4cd6c36ba851 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:35.799863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687cfe1-08eb-462c-98dd-4cd6c36ba851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:35.800141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687cfe1-08eb-462c-98dd-4cd6c36ba851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:35.808964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687cfe1-08eb-462c-98dd-4cd6c36ba851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:35.810415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687cfe1-08eb-462c-98dd-4cd6c36ba851 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:35.819961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 621/1245] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:38.730902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be2bf-25d9-40ce-8d33-ea4d27907256 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:38.731407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be2bf-25d9-40ce-8d33-ea4d27907256 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:38.731407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5be2bf-25d9-40ce-8d33-ea4d27907256 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:38.733297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 625/1246] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:38.738962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3653a-dbad-4de8-a040-b054fa80ef76 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:38.739377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3653a-dbad-4de8-a040-b054fa80ef76 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:38.739673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3653a-dbad-4de8-a040-b054fa80ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:38.757761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3de3653a-dbad-4de8-a040-b054fa80ef76 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:38.758944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3de3653a-dbad-4de8-a040-b054fa80ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:38.767018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 622/1247] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:38.805416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5be2bf-25d9-40ce-8d33-ea4d27907256 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:38.815724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5be2bf-25d9-40ce-8d33-ea4d27907256 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:38.819714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0386a-21a8-43a2-bdaa-4a5cdc4e4940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:38.820353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0386a-21a8-43a2-bdaa-4a5cdc4e4940 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:38.820631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0386a-21a8-43a2-bdaa-4a5cdc4e4940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:38.820912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0386a-21a8-43a2-bdaa-4a5cdc4e4940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:38.830184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0386a-21a8-43a2-bdaa-4a5cdc4e4940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:38.831616 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0386a-21a8-43a2-bdaa-4a5cdc4e4940 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:38.842878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 626/1248] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:43.102466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3939eb-d733-4120-88ce-5c2979670117 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.103022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3939eb-d733-4120-88ce-5c2979670117 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.103022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3939eb-d733-4120-88ce-5c2979670117 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.104808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 623/1249] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:43.111065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397870e-e2c1-436b-8338-7d228807422d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.111464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397870e-e2c1-436b-8338-7d228807422d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.111643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397870e-e2c1-436b-8338-7d228807422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.129206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4397870e-e2c1-436b-8338-7d228807422d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:43.130459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4397870e-e2c1-436b-8338-7d228807422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:43.138228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 627/1250] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:43.178313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3939eb-d733-4120-88ce-5c2979670117 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:43.188812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3939eb-d733-4120-88ce-5c2979670117 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:43.192523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3881-c7ff-447e-8a60-78d48f0d232d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:43.193730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3881-c7ff-447e-8a60-78d48f0d232d service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:43.194024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3881-c7ff-447e-8a60-78d48f0d232d service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:43.194325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3881-c7ff-447e-8a60-78d48f0d232d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:43.203408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3881-c7ff-447e-8a60-78d48f0d232d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:43.204781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3881-c7ff-447e-8a60-78d48f0d232d service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:43.215267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 624/1251] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:40:48.464395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a5d4-c480-416a-b699-d237d7a47a3f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.466025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a5d4-c480-416a-b699-d237d7a47a3f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.467280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4a5d4-c480-416a-b699-d237d7a47a3f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.473730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 628/1252] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:40:48 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:48.480146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5681f91-70c9-486b-974a-c5fd93eed75b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:48.480976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5681f91-70c9-486b-974a-c5fd93eed75b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:48.481260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5681f91-70c9-486b-974a-c5fd93eed75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:48.631708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d5681f91-70c9-486b-974a-c5fd93eed75b None None] MFA Rules not processed for user `32dbbc4af72f4d11a9b1876dba8e886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:48.634326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d5681f91-70c9-486b-974a-c5fd93eed75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:48.776629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 625/1253] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:40:48 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:40:53.258210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe04ec-4e0a-4018-9c7a-a914475a1167 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.258696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe04ec-4e0a-4018-9c7a-a914475a1167 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.258788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe04ec-4e0a-4018-9c7a-a914475a1167 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.260682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 629/1254] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:40:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:53.266123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac471-3d49-415f-bffc-3b7d2051481e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:53.266623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac471-3d49-415f-bffc-3b7d2051481e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:53.266713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ac471-3d49-415f-bffc-3b7d2051481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:53.286108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3f9ac471-3d49-415f-bffc-3b7d2051481e None None] MFA Rules not processed for user `32dbbc4af72f4d11a9b1876dba8e886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:53.287943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3f9ac471-3d49-415f-bffc-3b7d2051481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:53.297971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 626/1255] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:40:53 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:54.760589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf3720-1fbc-4dc5-9c0d-526606327590 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:54.761135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf3720-1fbc-4dc5-9c0d-526606327590 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:54.761813 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf3720-1fbc-4dc5-9c0d-526606327590 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:54.763732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 630/1256] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:40:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:54.769552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be5ccb-3bce-4cec-b271-867616e59445 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:54.770346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be5ccb-3bce-4cec-b271-867616e59445 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:54.770767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be5ccb-3bce-4cec-b271-867616e59445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:54.791956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b8be5ccb-3bce-4cec-b271-867616e59445 None None] MFA Rules not processed for user `32dbbc4af72f4d11a9b1876dba8e886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:54.793206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b8be5ccb-3bce-4cec-b271-867616e59445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:54.801716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 627/1257] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:40:54 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:58.726190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba11ed-58ed-436c-a109-256ac7ba7c7f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.727193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba11ed-58ed-436c-a109-256ac7ba7c7f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.727193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba11ed-58ed-436c-a109-256ac7ba7c7f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.728770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 631/1258] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:40:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:58.734829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a412-dda4-401f-895d-962edf9a63df None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.735255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a412-dda4-401f-895d-962edf9a63df None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.735383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a412-dda4-401f-895d-962edf9a63df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.756369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c009a412-dda4-401f-895d-962edf9a63df None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:58.757744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c009a412-dda4-401f-895d-962edf9a63df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:58.766011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 628/1259] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:40:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:58.816995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec192bf-34b4-4798-8772-d664b102c8a0 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.817281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec192bf-34b4-4798-8772-d664b102c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.817774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec192bf-34b4-4798-8772-d664b102c8a0 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.821915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 632/1260] 10.222.0.48 () {54 vars in 960 bytes} [Tue Oct 12 16:40:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:40:58.827816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4171-6c7f-4b9e-a342-a5253de535ef None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:58.828250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4171-6c7f-4b9e-a342-a5253de535ef None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:58.828637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4171-6c7f-4b9e-a342-a5253de535ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:58.878274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-abbd4171-6c7f-4b9e-a342-a5253de535ef None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:40:58.879623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-abbd4171-6c7f-4b9e-a342-a5253de535ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:40:58.971331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 629/1261] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Oct 12 16:40:58 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:40:58.981786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec192bf-34b4-4798-8772-d664b102c8a0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:40:58.996968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec192bf-34b4-4798-8772-d664b102c8a0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:40:59.002612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7edb16-2a0e-41d5-bd24-3bb8b1481858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:40:59.003256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7edb16-2a0e-41d5-bd24-3bb8b1481858 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:40:59.003548 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7edb16-2a0e-41d5-bd24-3bb8b1481858 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:40:59.003834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7edb16-2a0e-41d5-bd24-3bb8b1481858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:40:59.012969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7edb16-2a0e-41d5-bd24-3bb8b1481858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:40:59.014611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7edb16-2a0e-41d5-bd24-3bb8b1481858 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:40:59.024779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 633/1262] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:40:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:01.535106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539038-cfdc-49c3-be46-3c9c43526d76 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.535621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539038-cfdc-49c3-be46-3c9c43526d76 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.535621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3539038-cfdc-49c3-be46-3c9c43526d76 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.537932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 630/1263] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:01.544156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795cc4-5a77-42da-bfa5-fe27ddaf57de None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.544650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795cc4-5a77-42da-bfa5-fe27ddaf57de None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.544741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795cc4-5a77-42da-bfa5-fe27ddaf57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.562576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-89795cc4-5a77-42da-bfa5-fe27ddaf57de None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:01.563742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-89795cc4-5a77-42da-bfa5-fe27ddaf57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:01.572000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 634/1264] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:01.619612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539038-cfdc-49c3-be46-3c9c43526d76 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:01.635300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3539038-cfdc-49c3-be46-3c9c43526d76 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:01.641832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01c69a-66ee-4b05-881d-3571a2db859a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:01.642808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c69a-66ee-4b05-881d-3571a2db859a service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:01.643319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c69a-66ee-4b05-881d-3571a2db859a service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:01.643825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01c69a-66ee-4b05-881d-3571a2db859a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:01.654231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01c69a-66ee-4b05-881d-3571a2db859a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:01.656045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01c69a-66ee-4b05-881d-3571a2db859a service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:01.676939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 631/1265] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:04.302891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e77d2-cdc9-4016-aab6-a8a29aae9d1b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.303786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e77d2-cdc9-4016-aab6-a8a29aae9d1b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.304073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e77d2-cdc9-4016-aab6-a8a29aae9d1b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.306082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 635/1266] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:04.312437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964845c4-6d3b-4c68-9dc4-b2a2cd9768e3 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.312896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964845c4-6d3b-4c68-9dc4-b2a2cd9768e3 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.313000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964845c4-6d3b-4c68-9dc4-b2a2cd9768e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.333600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-964845c4-6d3b-4c68-9dc4-b2a2cd9768e3 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:04.335217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-964845c4-6d3b-4c68-9dc4-b2a2cd9768e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:04.343981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 632/1267] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:04.394280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779e270-b602-4d38-b174-eef437a663e3 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.395745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779e270-b602-4d38-b174-eef437a663e3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.395745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779e270-b602-4d38-b174-eef437a663e3 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.397133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 636/1268] 10.222.0.48 () {54 vars in 960 bytes} [Tue Oct 12 16:41:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:04.403398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db20e3-963a-4fc7-839e-3c74acd14012 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.403699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db20e3-963a-4fc7-839e-3c74acd14012 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.404122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db20e3-963a-4fc7-839e-3c74acd14012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.424397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-67db20e3-963a-4fc7-839e-3c74acd14012 None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:04.425616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-67db20e3-963a-4fc7-839e-3c74acd14012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:04.436513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 633/1269] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Oct 12 16:41:04 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:04.446079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779e270-b602-4d38-b174-eef437a663e3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:04.461879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779e270-b602-4d38-b174-eef437a663e3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:04.469861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab6f3a-cf38-4266-935d-ded299565719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:04.470631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab6f3a-cf38-4266-935d-ded299565719 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:04.471149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab6f3a-cf38-4266-935d-ded299565719 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:04.471525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab6f3a-cf38-4266-935d-ded299565719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:04.484259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab6f3a-cf38-4266-935d-ded299565719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:04.485405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab6f3a-cf38-4266-935d-ded299565719 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:04.496106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 637/1270] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:06.606972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ab7d1-469d-494b-9835-2e886b6cd1b9 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.607545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ab7d1-469d-494b-9835-2e886b6cd1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.607545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ab7d1-469d-494b-9835-2e886b6cd1b9 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:06.610570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 634/1271] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:06.616356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddff3e7-f617-4837-8599-8cda173af472 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.616823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddff3e7-f617-4837-8599-8cda173af472 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.616925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddff3e7-f617-4837-8599-8cda173af472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:06.635238 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5ddff3e7-f617-4837-8599-8cda173af472 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:06.636446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5ddff3e7-f617-4837-8599-8cda173af472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:06.645457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 638/1272] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:06.705165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a675086-0547-4de8-91dc-ee4c93e6b901 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.705481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a675086-0547-4de8-91dc-ee4c93e6b901 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.705978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a675086-0547-4de8-91dc-ee4c93e6b901 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:06.707890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 635/1273] 10.222.0.48 () {54 vars in 962 bytes} [Tue Oct 12 16:41:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:06.713887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be36fa-5176-4446-8c9c-f98c6fc5ddfc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.714182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be36fa-5176-4446-8c9c-f98c6fc5ddfc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.714467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be36fa-5176-4446-8c9c-f98c6fc5ddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:06.771350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-41be36fa-5176-4446-8c9c-f98c6fc5ddfc None None] MFA Rules not processed for user `9e128ed2736b4158ae2009df5ba23fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:06.772581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-41be36fa-5176-4446-8c9c-f98c6fc5ddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:06.834888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 639/1274] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Oct 12 16:41:06 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:06.844930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a675086-0547-4de8-91dc-ee4c93e6b901 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:06.857296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a675086-0547-4de8-91dc-ee4c93e6b901 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:06.860903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac42c0-66aa-4edd-9796-e1941c0fc721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:06.861645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac42c0-66aa-4edd-9796-e1941c0fc721 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.861991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac42c0-66aa-4edd-9796-e1941c0fc721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.862333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac42c0-66aa-4edd-9796-e1941c0fc721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:06.871756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac42c0-66aa-4edd-9796-e1941c0fc721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:06.873248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac42c0-66aa-4edd-9796-e1941c0fc721 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:06.881333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a885b8a-0539-49cd-9d97-2628c95ab513 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.881664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a885b8a-0539-49cd-9d97-2628c95ab513 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.882225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a885b8a-0539-49cd-9d97-2628c95ab513 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:06.883805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 636/1275] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:41:06.889127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 640/1276] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:06 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:06.890373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc30d-e575-4ee2-9ad3-57b60a9a410c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.890671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc30d-e575-4ee2-9ad3-57b60a9a410c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.890949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc30d-e575-4ee2-9ad3-57b60a9a410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:06.909766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-703bc30d-e575-4ee2-9ad3-57b60a9a410c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:06.910948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-703bc30d-e575-4ee2-9ad3-57b60a9a410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:06.926049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 637/1277] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:06.970396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a885b8a-0539-49cd-9d97-2628c95ab513 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:06.986166 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a885b8a-0539-49cd-9d97-2628c95ab513 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:06.991948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c04e30-e993-4deb-b6b7-8b3ee1fb2fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:06.992605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c04e30-e993-4deb-b6b7-8b3ee1fb2fe8 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:06.992893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c04e30-e993-4deb-b6b7-8b3ee1fb2fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:06.993177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c04e30-e993-4deb-b6b7-8b3ee1fb2fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:07.002629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c04e30-e993-4deb-b6b7-8b3ee1fb2fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:07.004146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c04e30-e993-4deb-b6b7-8b3ee1fb2fe8 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:07.017885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 641/1278] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:09.389363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fc77f-e89f-48fd-b648-29a26a2a3024 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.389952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fc77f-e89f-48fd-b648-29a26a2a3024 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.389952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fc77f-e89f-48fd-b648-29a26a2a3024 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.391643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 638/1279] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:09.398025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bfe43-d511-4a3a-a9cd-b3711475a134 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.398505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bfe43-d511-4a3a-a9cd-b3711475a134 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.398807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bfe43-d511-4a3a-a9cd-b3711475a134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.416807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e14bfe43-d511-4a3a-a9cd-b3711475a134 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:09.418038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e14bfe43-d511-4a3a-a9cd-b3711475a134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:09.426471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 642/1280] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:09.474658 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fc77f-e89f-48fd-b648-29a26a2a3024 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:09.488833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fc77f-e89f-48fd-b648-29a26a2a3024 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:09.495258 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe2903-c74c-4d04-9ece-278fc4e0e56e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:09.495912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe2903-c74c-4d04-9ece-278fc4e0e56e service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:09.496201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe2903-c74c-4d04-9ece-278fc4e0e56e service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:09.496486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe2903-c74c-4d04-9ece-278fc4e0e56e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:09.505402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe2903-c74c-4d04-9ece-278fc4e0e56e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:09.507456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe2903-c74c-4d04-9ece-278fc4e0e56e service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:09.517393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 639/1281] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:11.971686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda86b85-33d4-4fdf-a93d-ce60031f5f08 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:11.972054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda86b85-33d4-4fdf-a93d-ce60031f5f08 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:11.972162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda86b85-33d4-4fdf-a93d-ce60031f5f08 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:11.974521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 643/1282] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:41:11.980964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2577b8-181b-4821-bda0-0b5bc7193ef0 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:11.981863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2577b8-181b-4821-bda0-0b5bc7193ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:11.981863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2577b8-181b-4821-bda0-0b5bc7193ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.002176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1a2577b8-181b-4821-bda0-0b5bc7193ef0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:12.003894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1a2577b8-181b-4821-bda0-0b5bc7193ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:12.014717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 640/1283] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:12.064273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda86b85-33d4-4fdf-a93d-ce60031f5f08 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:12.080252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda86b85-33d4-4fdf-a93d-ce60031f5f08 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:12.087616 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0567831-8794-455e-9e7d-0e99ef6f09b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:12.088420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567831-8794-455e-9e7d-0e99ef6f09b4 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:12.088819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567831-8794-455e-9e7d-0e99ef6f09b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:12.089342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0567831-8794-455e-9e7d-0e99ef6f09b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:12.098561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567831-8794-455e-9e7d-0e99ef6f09b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:12.100367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0567831-8794-455e-9e7d-0e99ef6f09b4 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:12.110829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 644/1284] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:14.643103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64096-9d90-46b5-8a65-12743a5ccaa0 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:14.643727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64096-9d90-46b5-8a65-12743a5ccaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:14.643925 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc64096-9d90-46b5-8a65-12743a5ccaa0 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:14.647692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 641/1285] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:14.655889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4167e-7b3b-4ae0-a66f-10c4242e16c1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:14.656670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4167e-7b3b-4ae0-a66f-10c4242e16c1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:14.656670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4167e-7b3b-4ae0-a66f-10c4242e16c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:14.677806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-22a4167e-7b3b-4ae0-a66f-10c4242e16c1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:14.679339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-22a4167e-7b3b-4ae0-a66f-10c4242e16c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:14.687961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 645/1286] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:14.734904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc64096-9d90-46b5-8a65-12743a5ccaa0 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:14.751591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc64096-9d90-46b5-8a65-12743a5ccaa0 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:14.757808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff869a3-51f3-4f5c-b5ae-67b7e9502230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:14.758462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff869a3-51f3-4f5c-b5ae-67b7e9502230 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:14.758745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff869a3-51f3-4f5c-b5ae-67b7e9502230 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:14.759083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff869a3-51f3-4f5c-b5ae-67b7e9502230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:14.769967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff869a3-51f3-4f5c-b5ae-67b7e9502230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:14.772231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff869a3-51f3-4f5c-b5ae-67b7e9502230 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:14.783164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 642/1287] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:17.313316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1603da-1f56-4dd8-bedc-d57f38f3c739 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.313915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1603da-1f56-4dd8-bedc-d57f38f3c739 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.313915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1603da-1f56-4dd8-bedc-d57f38f3c739 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.315626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 646/1288] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:17.322061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185358-4877-4437-ab53-f2033ecae21f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.322879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185358-4877-4437-ab53-f2033ecae21f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.323172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185358-4877-4437-ab53-f2033ecae21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.343040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8b185358-4877-4437-ab53-f2033ecae21f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:17.344248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8b185358-4877-4437-ab53-f2033ecae21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:17.353437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 643/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:17.401038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1603da-1f56-4dd8-bedc-d57f38f3c739 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:17.416463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1603da-1f56-4dd8-bedc-d57f38f3c739 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:17.422335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b0c8b-e8d7-42e6-93a2-3f41dcdee369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:17.422985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0c8b-e8d7-42e6-93a2-3f41dcdee369 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:17.423271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0c8b-e8d7-42e6-93a2-3f41dcdee369 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:17.423550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b0c8b-e8d7-42e6-93a2-3f41dcdee369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:17.432837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b0c8b-e8d7-42e6-93a2-3f41dcdee369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:17.434462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b0c8b-e8d7-42e6-93a2-3f41dcdee369 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:17.444304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 647/1290] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:19.828351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814cad-dd6f-42a5-a78f-62dbbb4267d5 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.829308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814cad-dd6f-42a5-a78f-62dbbb4267d5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.829308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814cad-dd6f-42a5-a78f-62dbbb4267d5 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.831160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 644/1291] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:19.838537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108da6-8bf0-4dfb-be64-014824bfc80f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.839086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108da6-8bf0-4dfb-be64-014824bfc80f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.839185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108da6-8bf0-4dfb-be64-014824bfc80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.858839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f5108da6-8bf0-4dfb-be64-014824bfc80f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:19.860051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f5108da6-8bf0-4dfb-be64-014824bfc80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:19.868825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 648/1292] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:19.920912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814cad-dd6f-42a5-a78f-62dbbb4267d5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:19.936300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814cad-dd6f-42a5-a78f-62dbbb4267d5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:19.945209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb9284-ff9c-4030-ab17-6cb94b717099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:19.946209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9284-ff9c-4030-ab17-6cb94b717099 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:19.946588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9284-ff9c-4030-ab17-6cb94b717099 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:19.947028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb9284-ff9c-4030-ab17-6cb94b717099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:19.960195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb9284-ff9c-4030-ab17-6cb94b717099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:19.963145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb9284-ff9c-4030-ab17-6cb94b717099 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:19.977484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 645/1293] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:22.281873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b7065-7feb-4a26-972f-769faaa23373 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.282402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b7065-7feb-4a26-972f-769faaa23373 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.282402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b7065-7feb-4a26-972f-769faaa23373 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.284304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 649/1294] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:22.290454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0709-4a23-45d5-a5d2-95eac11fe8d7 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.290914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0709-4a23-45d5-a5d2-95eac11fe8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.291130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0709-4a23-45d5-a5d2-95eac11fe8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.294159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977bf4-4eba-49c5-ae0b-ef6134e68b40 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.294627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977bf4-4eba-49c5-ae0b-ef6134e68b40 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.295080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977bf4-4eba-49c5-ae0b-ef6134e68b40 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.298010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 650/1295] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:22.303616 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e02c8-425d-43e2-81aa-81f903c1c1d6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.303867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e02c8-425d-43e2-81aa-81f903c1c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.304315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e02c8-425d-43e2-81aa-81f903c1c1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.312663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0fde0709-4a23-45d5-a5d2-95eac11fe8d7 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:22.313896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0fde0709-4a23-45d5-a5d2-95eac11fe8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:22.321676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f32e02c8-425d-43e2-81aa-81f903c1c1d6 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:22.322606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 646/1296] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:22.322821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f32e02c8-425d-43e2-81aa-81f903c1c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:22.330577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 651/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:41:22.377164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0709-4a23-45d5-a5d2-95eac11fe8d7 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:22.384171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268effc6-6508-4a39-9cca-9df9588348d4 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.384464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268effc6-6508-4a39-9cca-9df9588348d4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.384741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268effc6-6508-4a39-9cca-9df9588348d4 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.386617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 652/1298] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 12 16:41:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:22.390055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0709-4a23-45d5-a5d2-95eac11fe8d7 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:22.392448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5512-debe-44af-9e18-cce6df8f692e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.392772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5512-debe-44af-9e18-cce6df8f692e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.393056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea5512-debe-44af-9e18-cce6df8f692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.396615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087403-de87-4502-80ae-812332d1db4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:22.397280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087403-de87-4502-80ae-812332d1db4e service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.397589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087403-de87-4502-80ae-812332d1db4e service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.398015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087403-de87-4502-80ae-812332d1db4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.406296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54087403-de87-4502-80ae-812332d1db4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:22.407880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54087403-de87-4502-80ae-812332d1db4e service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:22.417125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 647/1299] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:22.443472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a8ea5512-debe-44af-9e18-cce6df8f692e None None] MFA Rules not processed for user `6c767d4a9ad7459880884eb8c546dc55`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:22.444664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a8ea5512-debe-44af-9e18-cce6df8f692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:22.506819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 653/1300] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 12 16:41:22 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:22.515463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087403-de87-4502-80ae-812332d1db4e service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:22.525702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087403-de87-4502-80ae-812332d1db4e service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:22.529345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee16909-e627-42ac-bf7c-4b994a4534e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c767d4a9ad7459880884eb8c546dc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:22.530031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee16909-e627-42ac-bf7c-4b994a4534e2 service glance] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.530324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee16909-e627-42ac-bf7c-4b994a4534e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.530597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee16909-e627-42ac-bf7c-4b994a4534e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:22.540517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee16909-e627-42ac-bf7c-4b994a4534e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:22.541930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee16909-e627-42ac-bf7c-4b994a4534e2 service glance] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:22.552853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 648/1301] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:22.987244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dcf0-da8b-4e24-9a61-c0b4d2367ae6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:22.987539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dcf0-da8b-4e24-9a61-c0b4d2367ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:22.987820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dcf0-da8b-4e24-9a61-c0b4d2367ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.036823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ffe1dcf0-da8b-4e24-9a61-c0b4d2367ae6 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:23.038298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ffe1dcf0-da8b-4e24-9a61-c0b4d2367ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:23.099063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 654/1302] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:41:22 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:23.141013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f3f19-9d63-4e33-a99c-2b8a766bf3cf None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.141306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f3f19-9d63-4e33-a99c-2b8a766bf3cf None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.141673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f3f19-9d63-4e33-a99c-2b8a766bf3cf None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.143476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 649/1303] 10.222.0.48 () {54 vars in 942 bytes} [Tue Oct 12 16:41:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:23.150196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea412-7070-430d-8a28-2f270f758d40 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.150493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea412-7070-430d-8a28-2f270f758d40 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.150780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ea412-7070-430d-8a28-2f270f758d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.198648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-417ea412-7070-430d-8a28-2f270f758d40 None None] MFA Rules not processed for user `5c6cef3217904adcadea1a58a7b146e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:23.199869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-417ea412-7070-430d-8a28-2f270f758d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:23.272863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 655/1304] 10.222.0.48 () {58 vars in 1039 bytes} [Tue Oct 12 16:41:23 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:23.282498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f3f19-9d63-4e33-a99c-2b8a766bf3cf None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:23.296054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f3f19-9d63-4e33-a99c-2b8a766bf3cf None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:23.301004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44185759-fea2-4998-be8b-fce634387e98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:23.302276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185759-fea2-4998-be8b-fce634387e98 service swift] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:23.302569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185759-fea2-4998-be8b-fce634387e98 service swift] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:23.302848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185759-fea2-4998-be8b-fce634387e98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:23.311283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185759-fea2-4998-be8b-fce634387e98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:23.312853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185759-fea2-4998-be8b-fce634387e98 service swift] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:23.320848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 650/1305] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:41:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:41:24.724416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18c7d9-e38f-4ba8-b84b-77ca50fbea6e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.724934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18c7d9-e38f-4ba8-b84b-77ca50fbea6e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.725060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18c7d9-e38f-4ba8-b84b-77ca50fbea6e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.727096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 656/1306] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:24.733334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825c415-ebaa-4658-a8dc-f74809743ebd None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.733852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825c415-ebaa-4658-a8dc-f74809743ebd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.734306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825c415-ebaa-4658-a8dc-f74809743ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.758462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9825c415-ebaa-4658-a8dc-f74809743ebd None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:24.759983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9825c415-ebaa-4658-a8dc-f74809743ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:24.769254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 651/1307] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:24.820507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18c7d9-e38f-4ba8-b84b-77ca50fbea6e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:24.837221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18c7d9-e38f-4ba8-b84b-77ca50fbea6e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:24.843610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6705d76-fac4-4380-8c8a-06d6b8a7c3af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:24.844269 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705d76-fac4-4380-8c8a-06d6b8a7c3af service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:24.844554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705d76-fac4-4380-8c8a-06d6b8a7c3af service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:24.844831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705d76-fac4-4380-8c8a-06d6b8a7c3af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:24.854618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6705d76-fac4-4380-8c8a-06d6b8a7c3af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:24.856458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6705d76-fac4-4380-8c8a-06d6b8a7c3af service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:24.870294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 657/1308] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:27.205877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57467-39b8-4e49-9c73-c69998118b71 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.206482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57467-39b8-4e49-9c73-c69998118b71 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.206482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc57467-39b8-4e49-9c73-c69998118b71 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.208755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 652/1309] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:27.215941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c63c9-6671-4b0b-b116-a88e7f640251 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.215941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c63c9-6671-4b0b-b116-a88e7f640251 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.215941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c63c9-6671-4b0b-b116-a88e7f640251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.234761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8f1c63c9-6671-4b0b-b116-a88e7f640251 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:27.236084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8f1c63c9-6671-4b0b-b116-a88e7f640251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:27.246770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 658/1310] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:27.294164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc57467-39b8-4e49-9c73-c69998118b71 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:27.309148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc57467-39b8-4e49-9c73-c69998118b71 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:27.314601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78e7f4-d1ce-44cd-afcb-5e3fc0977b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:27.315237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78e7f4-d1ce-44cd-afcb-5e3fc0977b57 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:27.315519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78e7f4-d1ce-44cd-afcb-5e3fc0977b57 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:27.315795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78e7f4-d1ce-44cd-afcb-5e3fc0977b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:27.324969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78e7f4-d1ce-44cd-afcb-5e3fc0977b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:27.326588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78e7f4-d1ce-44cd-afcb-5e3fc0977b57 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:27.335977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 653/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:41:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:41:40.863574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652ba5-9896-49b6-869a-f310bf2a2b7b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.864134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652ba5-9896-49b6-869a-f310bf2a2b7b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.864236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae652ba5-9896-49b6-869a-f310bf2a2b7b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.866077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 659/1312] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:40.871965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2854d-9f26-4258-961f-374658758aa2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.872386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2854d-9f26-4258-961f-374658758aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.872532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2854d-9f26-4258-961f-374658758aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.890031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-19d2854d-9f26-4258-961f-374658758aa2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:40.891232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-19d2854d-9f26-4258-961f-374658758aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:40.900143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 654/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:40.925167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652ba5-9896-49b6-869a-f310bf2a2b7b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:40.937533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae652ba5-9896-49b6-869a-f310bf2a2b7b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:40.942481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b621f-150c-4db1-b8e2-453ba44d0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:40.943125 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b621f-150c-4db1-b8e2-453ba44d0b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:40.943409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b621f-150c-4db1-b8e2-453ba44d0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:40.943689 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b621f-150c-4db1-b8e2-453ba44d0b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:40.944429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b621f-150c-4db1-b8e2-453ba44d0b60 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:40.946311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b621f-150c-4db1-b8e2-453ba44d0b60 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:40.965820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 660/1314] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:41:40 2021] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:43.168597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9680c-b6cd-4b67-9007-2cdf0a579e96 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.169193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9680c-b6cd-4b67-9007-2cdf0a579e96 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.169193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9680c-b6cd-4b67-9007-2cdf0a579e96 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.171018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 655/1315] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:43.176787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f13c8c-e9bb-4c02-9097-0686d30cb1e3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.177232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f13c8c-e9bb-4c02-9097-0686d30cb1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.177391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f13c8c-e9bb-4c02-9097-0686d30cb1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.195231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-97f13c8c-e9bb-4c02-9097-0686d30cb1e3 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:43.196415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-97f13c8c-e9bb-4c02-9097-0686d30cb1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:43.204066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 661/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:43.228821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9680c-b6cd-4b67-9007-2cdf0a579e96 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.241583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9680c-b6cd-4b67-9007-2cdf0a579e96 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.245949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.246778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.247182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.247466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] PATH_INFO: `/v3/projects/3b38fac5719442ec8d74d1de558e09b0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.257808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] RBAC: Authorizing `identity:get_project(project_id=3b38fac5719442ec8d74d1de558e09b0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.259799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.261497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 656/1317] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/projects/3b38fac5719442ec8d74d1de558e09b0 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:43.267861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f13c8c-e9bb-4c02-9097-0686d30cb1e3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.276632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f13c8c-e9bb-4c02-9097-0686d30cb1e3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.281162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.281834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.282126 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.282410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.283184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] RBAC: Adding query filter params (scope.project.id=3b38fac5719442ec8d74d1de558e09b0) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:43.283498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.285323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.293464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 662/1318] 10.222.0.48 () {56 vars in 1231 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/role_assignments?scope.project.id=3b38fac5719442ec8d74d1de558e09b0 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:43.299698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.309934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137a7c6-5d3a-4fd5-b110-98e98054bcee admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.314565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457c9d6-e585-4d90-bec8-f3034dce101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.315404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c9d6-e585-4d90-bec8-f3034dce101a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.315685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c9d6-e585-4d90-bec8-f3034dce101a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.315959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c9d6-e585-4d90-bec8-f3034dce101a admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.317130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457c9d6-e585-4d90-bec8-f3034dce101a admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.319045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457c9d6-e585-4d90-bec8-f3034dce101a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.320637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 657/1319] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:43.329355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:43.339329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b224bc2-5a84-4569-9c2d-7dfb583d4a7f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:43.343835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aebc1e-efde-465f-aacf-65dcba2dc9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:43.344686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aebc1e-efde-465f-aacf-65dcba2dc9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:43.344969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aebc1e-efde-465f-aacf-65dcba2dc9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:43.345245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aebc1e-efde-465f-aacf-65dcba2dc9d0 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:43.358725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aebc1e-efde-465f-aacf-65dcba2dc9d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:43.360850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aebc1e-efde-465f-aacf-65dcba2dc9d0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:43.362512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 663/1320] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:43 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:45.662542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ca18-6885-46ca-920b-695f87f0b505 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.663112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ca18-6885-46ca-920b-695f87f0b505 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.663112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25ca18-6885-46ca-920b-695f87f0b505 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.664891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 658/1321] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:45.670830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe31d5-2bcc-49ea-b03c-e36780339bc2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.671257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe31d5-2bcc-49ea-b03c-e36780339bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.671400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe31d5-2bcc-49ea-b03c-e36780339bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.690155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d3fe31d5-2bcc-49ea-b03c-e36780339bc2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:45.691366 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d3fe31d5-2bcc-49ea-b03c-e36780339bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:45.699042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 664/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:45.724211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ca18-6885-46ca-920b-695f87f0b505 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.736573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25ca18-6885-46ca-920b-695f87f0b505 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.741088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.741958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.742247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.742528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] PATH_INFO: `/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.753244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] RBAC: Authorizing `identity:get_project(project_id=5cfeca2ec7b44c4e9ec8776849dbd884)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.755346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.757026 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 659/1323] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/projects/5cfeca2ec7b44c4e9ec8776849dbd884 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:45.763624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe31d5-2bcc-49ea-b03c-e36780339bc2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.773016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe31d5-2bcc-49ea-b03c-e36780339bc2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.777644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abafe0f-f133-46b7-b73e-19549aecec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.778282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abafe0f-f133-46b7-b73e-19549aecec08 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.778564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abafe0f-f133-46b7-b73e-19549aecec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.778842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abafe0f-f133-46b7-b73e-19549aecec08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.779617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abafe0f-f133-46b7-b73e-19549aecec08 admin admin] RBAC: Adding query filter params (scope.project.id=5cfeca2ec7b44c4e9ec8776849dbd884) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:45.779923 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abafe0f-f133-46b7-b73e-19549aecec08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.781784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abafe0f-f133-46b7-b73e-19549aecec08 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.787710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 665/1324] 10.222.0.48 () {56 vars in 1231 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/role_assignments?scope.project.id=5cfeca2ec7b44c4e9ec8776849dbd884 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:45.793834 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:45.803383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0b182-afe5-4b29-82ff-b2a179cb638f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:45.807976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d7a1d-8d28-4675-963f-cc6f09a22713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:45.808817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d7a1d-8d28-4675-963f-cc6f09a22713 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:45.809100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d7a1d-8d28-4675-963f-cc6f09a22713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:45.809400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d7a1d-8d28-4675-963f-cc6f09a22713 admin admin] PATH_INFO: `/v3/users/13ec4053378f47b487500f3d2da70432` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:45.810601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d7a1d-8d28-4675-963f-cc6f09a22713 admin admin] RBAC: Authorizing `identity:get_user(user_id=13ec4053378f47b487500f3d2da70432)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:45.812696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d7a1d-8d28-4675-963f-cc6f09a22713 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:45.814303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 660/1325] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:45 2021] GET /identity/v3/users/13ec4053378f47b487500f3d2da70432 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:48.064112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628505f5-ef76-4c7f-80fe-1b1e8aedd8a5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.064635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628505f5-ef76-4c7f-80fe-1b1e8aedd8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.064751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628505f5-ef76-4c7f-80fe-1b1e8aedd8a5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.066603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 666/1326] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:48.073016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7605-1057-4638-aa26-8c80f3ccf72d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.073478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7605-1057-4638-aa26-8c80f3ccf72d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.073594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef7605-1057-4638-aa26-8c80f3ccf72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.091807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-03ef7605-1057-4638-aa26-8c80f3ccf72d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:48.092990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-03ef7605-1057-4638-aa26-8c80f3ccf72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:48.100763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 661/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:48.123674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628505f5-ef76-4c7f-80fe-1b1e8aedd8a5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:48.136207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628505f5-ef76-4c7f-80fe-1b1e8aedd8a5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:48.140578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:48.141427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.141712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.141987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] PATH_INFO: `/v3/projects/5d40943e3fb14e179bf297f0bc46469a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.152865 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] RBAC: Authorizing `identity:get_project(project_id=5d40943e3fb14e179bf297f0bc46469a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:48.154951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:48.156612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 667/1328] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:48 2021] GET /identity/v3/projects/5d40943e3fb14e179bf297f0bc46469a => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:48.164364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef7605-1057-4638-aa26-8c80f3ccf72d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:48.173328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef7605-1057-4638-aa26-8c80f3ccf72d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:48.177895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b3c92-c904-4203-919a-1bb370d7bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:48.178530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3c92-c904-4203-919a-1bb370d7bd6d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.178815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3c92-c904-4203-919a-1bb370d7bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.179093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b3c92-c904-4203-919a-1bb370d7bd6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.179866 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3c92-c904-4203-919a-1bb370d7bd6d admin admin] RBAC: Adding query filter params (scope.project.id=5d40943e3fb14e179bf297f0bc46469a) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:48.180181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3c92-c904-4203-919a-1bb370d7bd6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:48.182062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b3c92-c904-4203-919a-1bb370d7bd6d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:48.188338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 662/1329] 10.222.0.48 () {56 vars in 1231 bytes} [Tue Oct 12 16:41:48 2021] GET /identity/v3/role_assignments?scope.project.id=5d40943e3fb14e179bf297f0bc46469a => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:48.195137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:48.204591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb55458-5e0e-4b48-8eea-dba64872271e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:48.209709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bf8df-e907-4dae-b422-1168bffb7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:48.210575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bf8df-e907-4dae-b422-1168bffb7ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:48.210860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bf8df-e907-4dae-b422-1168bffb7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:48.211137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bf8df-e907-4dae-b422-1168bffb7ab0 admin admin] PATH_INFO: `/v3/users/4899b324ddbd41d6981a3c258acd19c5` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:48.224473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bf8df-e907-4dae-b422-1168bffb7ab0 admin admin] RBAC: Authorizing `identity:get_user(user_id=4899b324ddbd41d6981a3c258acd19c5)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:48.226644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bf8df-e907-4dae-b422-1168bffb7ab0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:48.228278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 668/1330] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:48 2021] GET /identity/v3/users/4899b324ddbd41d6981a3c258acd19c5 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:50.510163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8db3-73de-42cd-8424-f07d2fd6c189 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.510741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8db3-73de-42cd-8424-f07d2fd6c189 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.510741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b8db3-73de-42cd-8424-f07d2fd6c189 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.512544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 663/1331] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:50.518757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d153c2-c311-403b-8a5c-e0c0eb0182ad None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.519203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d153c2-c311-403b-8a5c-e0c0eb0182ad None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.519312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d153c2-c311-403b-8a5c-e0c0eb0182ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.536920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f3d153c2-c311-403b-8a5c-e0c0eb0182ad None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:50.538190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f3d153c2-c311-403b-8a5c-e0c0eb0182ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:50.545941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 669/1332] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:50.570108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8db3-73de-42cd-8424-f07d2fd6c189 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.583097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b8db3-73de-42cd-8424-f07d2fd6c189 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.587805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.588643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.588927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.589211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] PATH_INFO: `/v3/projects/64da0972f6f84075a0e8956810e3e6c1` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.590428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] RBAC: Authorizing `identity:get_project(project_id=64da0972f6f84075a0e8956810e3e6c1)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.592206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.593908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 664/1333] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/projects/64da0972f6f84075a0e8956810e3e6c1 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:50.600571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d153c2-c311-403b-8a5c-e0c0eb0182ad None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.609471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d153c2-c311-403b-8a5c-e0c0eb0182ad None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.614038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcd834-26cb-4b3b-9afc-9bd5244ee56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.614672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcd834-26cb-4b3b-9afc-9bd5244ee56a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.614957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcd834-26cb-4b3b-9afc-9bd5244ee56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.615319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcd834-26cb-4b3b-9afc-9bd5244ee56a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.616122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcd834-26cb-4b3b-9afc-9bd5244ee56a admin admin] RBAC: Adding query filter params (scope.project.id=64da0972f6f84075a0e8956810e3e6c1) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:50.616430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcd834-26cb-4b3b-9afc-9bd5244ee56a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.618289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcd834-26cb-4b3b-9afc-9bd5244ee56a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.623877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 670/1334] 10.222.0.48 () {56 vars in 1231 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/role_assignments?scope.project.id=64da0972f6f84075a0e8956810e3e6c1 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:50.630697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:50.640462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa200-8c85-480c-9e63-3a095e39fcdb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:50.645050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f13065-941e-4c72-8395-129586665dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:50.645924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f13065-941e-4c72-8395-129586665dee admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:50.646214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f13065-941e-4c72-8395-129586665dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:50.646497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f13065-941e-4c72-8395-129586665dee admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:50.647719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f13065-941e-4c72-8395-129586665dee admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:50.649523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f13065-941e-4c72-8395-129586665dee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:50.651094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 665/1335] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:50 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:52.936527 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8b90-4d15-4964-bd1c-1623d54e3e99 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:52.937085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8b90-4d15-4964-bd1c-1623d54e3e99 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:52.937085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8b90-4d15-4964-bd1c-1623d54e3e99 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:52.938904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 671/1336] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:52.944935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764a99-6bc5-4077-87b2-214578df1615 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:52.945352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764a99-6bc5-4077-87b2-214578df1615 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:52.945540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764a99-6bc5-4077-87b2-214578df1615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:52.963599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7c764a99-6bc5-4077-87b2-214578df1615 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:52.964789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7c764a99-6bc5-4077-87b2-214578df1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:52.972512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 666/1337] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:52.996565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8b90-4d15-4964-bd1c-1623d54e3e99 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.009474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8b90-4d15-4964-bd1c-1623d54e3e99 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.013954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.014790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.015072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.015350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] PATH_INFO: `/v3/projects/7e294ab438ef48a9a71b5903dd0237d6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.027756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] RBAC: Authorizing `identity:get_project(project_id=7e294ab438ef48a9a71b5903dd0237d6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.029867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.031621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 672/1338] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:52 2021] GET /identity/v3/projects/7e294ab438ef48a9a71b5903dd0237d6 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:53.038886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764a99-6bc5-4077-87b2-214578df1615 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.047871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764a99-6bc5-4077-87b2-214578df1615 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.052445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.053082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.053367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.053673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.054453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] RBAC: Adding query filter params (scope.project.id=7e294ab438ef48a9a71b5903dd0237d6) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:53.054761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.056594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.062290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 667/1339] 10.222.0.48 () {56 vars in 1231 bytes} [Tue Oct 12 16:41:53 2021] GET /identity/v3/role_assignments?scope.project.id=7e294ab438ef48a9a71b5903dd0237d6 => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:53.068564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.078300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810cb1-1193-4294-b3bd-243f701179dc admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.083612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ad18b-8fdd-4658-9c4c-b522009014db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.084457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ad18b-8fdd-4658-9c4c-b522009014db admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.084741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ad18b-8fdd-4658-9c4c-b522009014db admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.085017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ad18b-8fdd-4658-9c4c-b522009014db admin admin] PATH_INFO: `/v3/users/f70a33a7bd3947c397e1374c658fe375` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.099058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ad18b-8fdd-4658-9c4c-b522009014db admin admin] RBAC: Authorizing `identity:get_user(user_id=f70a33a7bd3947c397e1374c658fe375)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.101158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ad18b-8fdd-4658-9c4c-b522009014db admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.103074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 673/1340] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:53 2021] GET /identity/v3/users/f70a33a7bd3947c397e1374c658fe375 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:53.109089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:53.118806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315beec4-ad26-4a71-80e1-4e935753350e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:53.123348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b3b74-9aa3-4c99-b7ee-3164b2a80b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:53.124188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b3b74-9aa3-4c99-b7ee-3164b2a80b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:53.124470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b3b74-9aa3-4c99-b7ee-3164b2a80b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:53.124745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b3b74-9aa3-4c99-b7ee-3164b2a80b3d admin admin] PATH_INFO: `/v3/users/9e536803a2bf41479d4b32a72449ea4a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:53.137703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b3b74-9aa3-4c99-b7ee-3164b2a80b3d admin admin] RBAC: Authorizing `identity:get_user(user_id=9e536803a2bf41479d4b32a72449ea4a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:53.139818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b3b74-9aa3-4c99-b7ee-3164b2a80b3d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:53.141449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 668/1341] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:53 2021] GET /identity/v3/users/9e536803a2bf41479d4b32a72449ea4a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:55.448506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac45f8-ce9d-4e7e-b92a-b5cf21e60c8b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.449033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac45f8-ce9d-4e7e-b92a-b5cf21e60c8b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.449033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac45f8-ce9d-4e7e-b92a-b5cf21e60c8b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.450869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 674/1342] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:55.456766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77392f-6fa5-4b4c-b47c-fffbbda00205 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.457203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77392f-6fa5-4b4c-b47c-fffbbda00205 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.457415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77392f-6fa5-4b4c-b47c-fffbbda00205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.475043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ca77392f-6fa5-4b4c-b47c-fffbbda00205 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:55.476219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ca77392f-6fa5-4b4c-b47c-fffbbda00205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:55.483833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 669/1343] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:55.507530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac45f8-ce9d-4e7e-b92a-b5cf21e60c8b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.519682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac45f8-ce9d-4e7e-b92a-b5cf21e60c8b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.524099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.524923 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.525201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.525517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] PATH_INFO: `/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.536287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] RBAC: Authorizing `identity:get_project(project_id=a8811b64990c4a0ea56cbcf09918f4dc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:55.538355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:55.540032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 675/1344] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/projects/a8811b64990c4a0ea56cbcf09918f4dc => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:55.546553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77392f-6fa5-4b4c-b47c-fffbbda00205 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.556414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77392f-6fa5-4b4c-b47c-fffbbda00205 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.560943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e0efc-2bba-4770-b73a-22d2bc03030f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.561596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e0efc-2bba-4770-b73a-22d2bc03030f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.561879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e0efc-2bba-4770-b73a-22d2bc03030f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.562152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e0efc-2bba-4770-b73a-22d2bc03030f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.562924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e0efc-2bba-4770-b73a-22d2bc03030f admin admin] RBAC: Adding query filter params (scope.project.id=a8811b64990c4a0ea56cbcf09918f4dc) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:55.563228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e0efc-2bba-4770-b73a-22d2bc03030f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:55.565046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e0efc-2bba-4770-b73a-22d2bc03030f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:55.570375 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 670/1345] 10.222.0.48 () {56 vars in 1231 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/role_assignments?scope.project.id=a8811b64990c4a0ea56cbcf09918f4dc => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:41:55.576534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:55.586661 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33e15a-c024-40ed-a159-fb16405c271c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:55.591526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603c6b3-c608-4e06-9282-17363f8283f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:55.592371 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c6b3-c608-4e06-9282-17363f8283f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:55.592658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c6b3-c608-4e06-9282-17363f8283f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:55.592936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603c6b3-c608-4e06-9282-17363f8283f3 admin admin] PATH_INFO: `/v3/users/1f85d22e54b9445081a7e1b47258fc33` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:55.606707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603c6b3-c608-4e06-9282-17363f8283f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=1f85d22e54b9445081a7e1b47258fc33)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:55.608820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603c6b3-c608-4e06-9282-17363f8283f3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:55.610471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 676/1346] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:55 2021] GET /identity/v3/users/1f85d22e54b9445081a7e1b47258fc33 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:57.889226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c71293-b2e4-4aa0-a2bc-91761da655be None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:57.889854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c71293-b2e4-4aa0-a2bc-91761da655be None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:57.889983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c71293-b2e4-4aa0-a2bc-91761da655be None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:57.891872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 671/1347] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:41:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:41:57.898792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7520-d2fb-4606-8ff0-732948157434 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:57.899256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7520-d2fb-4606-8ff0-732948157434 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:57.899356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7520-d2fb-4606-8ff0-732948157434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:57.916606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-72eb7520-d2fb-4606-8ff0-732948157434 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:41:57.917832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-72eb7520-d2fb-4606-8ff0-732948157434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:41:57.925767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 677/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:41:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:41:57.948951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c71293-b2e4-4aa0-a2bc-91761da655be None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:57.961805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c71293-b2e4-4aa0-a2bc-91761da655be None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:57.966463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:57.967291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:57.967572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:57.967845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] PATH_INFO: `/v3/projects/d33cbbd3852e4283836762f9edd90a57` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:57.979022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] RBAC: Authorizing `identity:get_project(project_id=d33cbbd3852e4283836762f9edd90a57)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:57.981051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:57.982742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 672/1349] 10.222.0.48 () {56 vars in 1207 bytes} [Tue Oct 12 16:41:57 2021] GET /identity/v3/projects/d33cbbd3852e4283836762f9edd90a57 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:57.989282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb7520-d2fb-4606-8ff0-732948157434 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:57.998230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb7520-d2fb-4606-8ff0-732948157434 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.003103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.003506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.003798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.004076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.004878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] RBAC: Adding query filter params (scope.project.id=d33cbbd3852e4283836762f9edd90a57) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:41:58.005186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.007076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.014787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 678/1350] 10.222.0.48 () {56 vars in 1231 bytes} [Tue Oct 12 16:41:57 2021] GET /identity/v3/role_assignments?scope.project.id=d33cbbd3852e4283836762f9edd90a57 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:41:58.022379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.031990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5a9f6-952f-4b6e-aa21-0cc6fd9c230f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.037099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d586b7c-6cb0-4d94-9428-0fcfbc38f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.038087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d586b7c-6cb0-4d94-9428-0fcfbc38f246 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.038376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d586b7c-6cb0-4d94-9428-0fcfbc38f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.038654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d586b7c-6cb0-4d94-9428-0fcfbc38f246 admin admin] PATH_INFO: `/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.051771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d586b7c-6cb0-4d94-9428-0fcfbc38f246 admin admin] RBAC: Authorizing `identity:get_user(user_id=a27299ef7f5a4c83bafcf85db2ea4e0f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.053924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d586b7c-6cb0-4d94-9428-0fcfbc38f246 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.055848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 673/1351] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/users/a27299ef7f5a4c83bafcf85db2ea4e0f => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:41:58.062060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:41:58.073940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b2bd-74fb-49ca-8d00-66991784e6f9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:41:58.078478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64644fdf-4d11-4056-bb96-03ba6c85a3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:41:58.079323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64644fdf-4d11-4056-bb96-03ba6c85a3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:41:58.079609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64644fdf-4d11-4056-bb96-03ba6c85a3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:41:58.079886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64644fdf-4d11-4056-bb96-03ba6c85a3b4 admin admin] PATH_INFO: `/v3/users/d4d408e2598343a193d18277dfdc0252` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:41:58.081063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64644fdf-4d11-4056-bb96-03ba6c85a3b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=d4d408e2598343a193d18277dfdc0252)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:41:58.083385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64644fdf-4d11-4056-bb96-03ba6c85a3b4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:41:58.084960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 679/1352] 10.222.0.48 () {56 vars in 1198 bytes} [Tue Oct 12 16:41:58 2021] GET /identity/v3/users/d4d408e2598343a193d18277dfdc0252 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:42:03.337937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e020-b50e-4411-ad50-88d11ecb0da2 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:03.338454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e020-b50e-4411-ad50-88d11ecb0da2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:03.338454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e020-b50e-4411-ad50-88d11ecb0da2 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:03.340178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 674/1353] 10.222.0.48 () {54 vars in 918 bytes} [Tue Oct 12 16:42:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:03.345937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d16c-26cc-4ceb-a4f3-b761aa8ca9fb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:03.346348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d16c-26cc-4ceb-a4f3-b761aa8ca9fb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:03.346506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d16c-26cc-4ceb-a4f3-b761aa8ca9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:03.364883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1005d16c-26cc-4ceb-a4f3-b761aa8ca9fb None None] MFA Rules not processed for user `32dbbc4af72f4d11a9b1876dba8e886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:03.366108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1005d16c-26cc-4ceb-a4f3-b761aa8ca9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:03.374409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 680/1354] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Oct 12 16:42:03 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:03.390234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308208b-f521-4336-bd9c-382c8a32ca5e None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:03.390523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308208b-f521-4336-bd9c-382c8a32ca5e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:03.390798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308208b-f521-4336-bd9c-382c8a32ca5e None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:03.392582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 675/1355] 10.222.0.48 () {54 vars in 918 bytes} [Tue Oct 12 16:42:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:03.397948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df722e-c362-47dd-bba9-452f41e7e53e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:03.398264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df722e-c362-47dd-bba9-452f41e7e53e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:03.398541 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df722e-c362-47dd-bba9-452f41e7e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:03.422240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-26df722e-c362-47dd-bba9-452f41e7e53e None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:03.423426 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-26df722e-c362-47dd-bba9-452f41e7e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:03.432892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 681/1356] 10.222.0.48 () {58 vars in 1015 bytes} [Tue Oct 12 16:42:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:06.293148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21c2d-9c30-49c1-82fb-f1108025680c None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.293713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21c2d-9c30-49c1-82fb-f1108025680c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.293713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e21c2d-9c30-49c1-82fb-f1108025680c None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.295495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 676/1357] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:06.301602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef012-0916-476a-90ae-4c18a72d7e2e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.302028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef012-0916-476a-90ae-4c18a72d7e2e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.302168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ef012-0916-476a-90ae-4c18a72d7e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.319307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-124ef012-0916-476a-90ae-4c18a72d7e2e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:06.320478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-124ef012-0916-476a-90ae-4c18a72d7e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:06.328047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 682/1358] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:06.372845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e21c2d-9c30-49c1-82fb-f1108025680c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:06.386913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e21c2d-9c30-49c1-82fb-f1108025680c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:06.392288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aac8c-7742-4477-923b-75a37bbb22cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:06.392918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aac8c-7742-4477-923b-75a37bbb22cc service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:06.393202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aac8c-7742-4477-923b-75a37bbb22cc service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:06.393516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aac8c-7742-4477-923b-75a37bbb22cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:06.401893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aac8c-7742-4477-923b-75a37bbb22cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:06.403457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aac8c-7742-4477-923b-75a37bbb22cc service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:06.413113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 677/1359] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:07.904803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247e681-3608-4c15-bed9-691c91983cd5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:07.905385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247e681-3608-4c15-bed9-691c91983cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:07.905385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247e681-3608-4c15-bed9-691c91983cd5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:07.907174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 683/1360] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:07.912704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f951c-0e2a-40ac-b35f-c69c064dbb8e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:07.913149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f951c-0e2a-40ac-b35f-c69c064dbb8e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:07.913268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f951c-0e2a-40ac-b35f-c69c064dbb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:07.931414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-987f951c-0e2a-40ac-b35f-c69c064dbb8e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:07.932613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-987f951c-0e2a-40ac-b35f-c69c064dbb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:07.940373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 678/1361] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:08.093176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247e681-3608-4c15-bed9-691c91983cd5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:08.107471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247e681-3608-4c15-bed9-691c91983cd5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:08.112713 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b36e38-1cd0-4d81-ac21-8deaf43e7ab4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:08.114005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36e38-1cd0-4d81-ac21-8deaf43e7ab4 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:08.114291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36e38-1cd0-4d81-ac21-8deaf43e7ab4 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:08.114568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b36e38-1cd0-4d81-ac21-8deaf43e7ab4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:08.122839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b36e38-1cd0-4d81-ac21-8deaf43e7ab4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:08.124403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b36e38-1cd0-4d81-ac21-8deaf43e7ab4 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:08.133628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 684/1362] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:09.617259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33536176-e1e6-4925-85ca-e123b7fd46e6 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.618021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33536176-e1e6-4925-85ca-e123b7fd46e6 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.618021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33536176-e1e6-4925-85ca-e123b7fd46e6 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.619614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 679/1363] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:09.625103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b791-9eff-499f-b222-9e0d73671fb4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.625635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b791-9eff-499f-b222-9e0d73671fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.625774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b791-9eff-499f-b222-9e0d73671fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.643090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-34a4b791-9eff-499f-b222-9e0d73671fb4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:09.644278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-34a4b791-9eff-499f-b222-9e0d73671fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:09.652018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 685/1364] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:09.806383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33536176-e1e6-4925-85ca-e123b7fd46e6 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:09.820327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33536176-e1e6-4925-85ca-e123b7fd46e6 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:09.825663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ec6e4-a221-4609-8622-17fa0a2efe25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:09.826297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec6e4-a221-4609-8622-17fa0a2efe25 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:09.826584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec6e4-a221-4609-8622-17fa0a2efe25 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:09.826861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec6e4-a221-4609-8622-17fa0a2efe25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:09.835407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ec6e4-a221-4609-8622-17fa0a2efe25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:09.842916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ec6e4-a221-4609-8622-17fa0a2efe25 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:09.852493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 680/1365] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:11.281095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef83e9-92e7-43ff-b6c6-fe80d1fdf032 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.281667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef83e9-92e7-43ff-b6c6-fe80d1fdf032 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.281667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef83e9-92e7-43ff-b6c6-fe80d1fdf032 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.283386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 686/1366] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:42:11.289681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8206992-49fc-4796-928e-5a338e893adf None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.290163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8206992-49fc-4796-928e-5a338e893adf None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.290265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8206992-49fc-4796-928e-5a338e893adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.307764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f8206992-49fc-4796-928e-5a338e893adf None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:11.308933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f8206992-49fc-4796-928e-5a338e893adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:11.316548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 681/1367] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:11.469175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef83e9-92e7-43ff-b6c6-fe80d1fdf032 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:11.483167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef83e9-92e7-43ff-b6c6-fe80d1fdf032 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:11.489123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc85c4-7e5e-42e8-aa09-5be695147117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:11.490158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc85c4-7e5e-42e8-aa09-5be695147117 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:11.490158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc85c4-7e5e-42e8-aa09-5be695147117 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:11.490460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc85c4-7e5e-42e8-aa09-5be695147117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:11.498534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc85c4-7e5e-42e8-aa09-5be695147117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:11.500122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc85c4-7e5e-42e8-aa09-5be695147117 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:11.509637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 687/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:12.946172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd035-18fe-49ca-8199-7fece3627d1b None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:12.946731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd035-18fe-49ca-8199-7fece3627d1b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:12.946731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecd035-18fe-49ca-8199-7fece3627d1b None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:12.948528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 682/1369] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:12.954072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7efe-c9d8-4e05-bc7a-fe337b329f1a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:12.954535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7efe-c9d8-4e05-bc7a-fe337b329f1a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:12.954649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd7efe-c9d8-4e05-bc7a-fe337b329f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:12.972115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4ecd7efe-c9d8-4e05-bc7a-fe337b329f1a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:12.973324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4ecd7efe-c9d8-4e05-bc7a-fe337b329f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:12.981047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 688/1370] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:13.133575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd035-18fe-49ca-8199-7fece3627d1b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:13.148162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecd035-18fe-49ca-8199-7fece3627d1b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:13.153529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f748f-aece-49b3-87e1-5d5ce030ba64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:13.154163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f748f-aece-49b3-87e1-5d5ce030ba64 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:13.154447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f748f-aece-49b3-87e1-5d5ce030ba64 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:13.154723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f748f-aece-49b3-87e1-5d5ce030ba64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:13.162790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f748f-aece-49b3-87e1-5d5ce030ba64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:13.164351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f748f-aece-49b3-87e1-5d5ce030ba64 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:13.173535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 683/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:14.555774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82b5d-6d21-4466-b443-a15ac6f7e57e None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.556338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82b5d-6d21-4466-b443-a15ac6f7e57e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.556338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db82b5d-6d21-4466-b443-a15ac6f7e57e None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.558131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 689/1372] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:14.563567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d582b8-ee1a-41b9-b4b8-bbd7b4463861 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.563976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d582b8-ee1a-41b9-b4b8-bbd7b4463861 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.564127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d582b8-ee1a-41b9-b4b8-bbd7b4463861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.581939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-54d582b8-ee1a-41b9-b4b8-bbd7b4463861 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:14.583129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-54d582b8-ee1a-41b9-b4b8-bbd7b4463861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:14.591363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 684/1373] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:14.745678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db82b5d-6d21-4466-b443-a15ac6f7e57e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:14.760275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db82b5d-6d21-4466-b443-a15ac6f7e57e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:14.765267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b68924-ae3b-4213-9a03-0bf57c2748d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:14.765940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b68924-ae3b-4213-9a03-0bf57c2748d3 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:14.766228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b68924-ae3b-4213-9a03-0bf57c2748d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:14.766507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b68924-ae3b-4213-9a03-0bf57c2748d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:14.774490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b68924-ae3b-4213-9a03-0bf57c2748d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:14.776065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b68924-ae3b-4213-9a03-0bf57c2748d3 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:14.785992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 690/1374] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:16.180619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a03d2d-b3e9-4563-8de2-7980ae61b0d9 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.181198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a03d2d-b3e9-4563-8de2-7980ae61b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.181198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a03d2d-b3e9-4563-8de2-7980ae61b0d9 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.183019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 685/1375] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:16.188411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5bccd-97d8-48da-b1f5-157cb0446e43 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.188802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5bccd-97d8-48da-b1f5-157cb0446e43 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.188981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5bccd-97d8-48da-b1f5-157cb0446e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.207072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-25e5bccd-97d8-48da-b1f5-157cb0446e43 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:16.208259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-25e5bccd-97d8-48da-b1f5-157cb0446e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:16.216253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 691/1376] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:16.370495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a03d2d-b3e9-4563-8de2-7980ae61b0d9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:16.384618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a03d2d-b3e9-4563-8de2-7980ae61b0d9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:16.391719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d11d5c-65ad-4f59-b843-adcdcea1e000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:16.392357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d11d5c-65ad-4f59-b843-adcdcea1e000 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:16.392644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d11d5c-65ad-4f59-b843-adcdcea1e000 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:16.392920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d11d5c-65ad-4f59-b843-adcdcea1e000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:16.400922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d11d5c-65ad-4f59-b843-adcdcea1e000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:16.402542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d11d5c-65ad-4f59-b843-adcdcea1e000 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:16.412274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 686/1377] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:42:17.808159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e001529-478e-4ff8-88bd-a4ae09ddf6b8 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:17.808725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e001529-478e-4ff8-88bd-a4ae09ddf6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:17.808725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e001529-478e-4ff8-88bd-a4ae09ddf6b8 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:17.810563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 692/1378] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:17.816087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a72ad-e432-4dff-a27f-bd2e4becf84f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:17.816468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a72ad-e432-4dff-a27f-bd2e4becf84f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:17.816644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a72ad-e432-4dff-a27f-bd2e4becf84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:17.835104 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-805a72ad-e432-4dff-a27f-bd2e4becf84f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:17.836303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-805a72ad-e432-4dff-a27f-bd2e4becf84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:17.844280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 687/1379] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:17.998344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e001529-478e-4ff8-88bd-a4ae09ddf6b8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:18.012547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e001529-478e-4ff8-88bd-a4ae09ddf6b8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:18.017908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61b22a-85e1-40af-8850-170a60379952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:18.018541 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b22a-85e1-40af-8850-170a60379952 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:18.018826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b22a-85e1-40af-8850-170a60379952 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:18.019102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61b22a-85e1-40af-8850-170a60379952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:18.026978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b22a-85e1-40af-8850-170a60379952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:18.028549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61b22a-85e1-40af-8850-170a60379952 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:18.038273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 693/1380] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:19.420504 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6b074-b48e-4191-8439-a032b8219320 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:19.421055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6b074-b48e-4191-8439-a032b8219320 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:19.421055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6b074-b48e-4191-8439-a032b8219320 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:19.422870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 688/1381] 10.222.0.48 () {54 vars in 911 bytes} [Tue Oct 12 16:42:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:19.429932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a4c9-f61c-4acc-aa72-3e2f1d68cbc2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:19.430342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a4c9-f61c-4acc-aa72-3e2f1d68cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:19.430492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1758a4c9-f61c-4acc-aa72-3e2f1d68cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:19.447864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1758a4c9-f61c-4acc-aa72-3e2f1d68cbc2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:19.449116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1758a4c9-f61c-4acc-aa72-3e2f1d68cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:19.457107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 694/1382] 10.222.0.48 () {58 vars in 1008 bytes} [Tue Oct 12 16:42:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:19.609578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6b074-b48e-4191-8439-a032b8219320 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:19.623592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6b074-b48e-4191-8439-a032b8219320 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:19.628975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a49bd5-87ef-46fa-8d7e-2d40eb247349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:19.629638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49bd5-87ef-46fa-8d7e-2d40eb247349 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:19.629922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49bd5-87ef-46fa-8d7e-2d40eb247349 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:19.630204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49bd5-87ef-46fa-8d7e-2d40eb247349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:19.638175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a49bd5-87ef-46fa-8d7e-2d40eb247349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:19.639749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a49bd5-87ef-46fa-8d7e-2d40eb247349 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:19.649546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 689/1383] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:21.777084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd64f-80c5-4d64-839a-fe727ded0ede None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.777708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd64f-80c5-4d64-839a-fe727ded0ede None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.777708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd64f-80c5-4d64-839a-fe727ded0ede None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.779476 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 695/1384] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:21.785916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adebbfd-efd1-479b-b5a5-2b5efc179eba None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.786328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adebbfd-efd1-479b-b5a5-2b5efc179eba None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.786470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adebbfd-efd1-479b-b5a5-2b5efc179eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.804101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2adebbfd-efd1-479b-b5a5-2b5efc179eba None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:21.805274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2adebbfd-efd1-479b-b5a5-2b5efc179eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:21.812847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 690/1385] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:21.852768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fd64f-80c5-4d64-839a-fe727ded0ede None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:21.863280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fd64f-80c5-4d64-839a-fe727ded0ede None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:21.866837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3514a-05d6-4379-845b-117cd8f36f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:21.867464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3514a-05d6-4379-845b-117cd8f36f9c service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:21.867750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3514a-05d6-4379-845b-117cd8f36f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:21.868029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3514a-05d6-4379-845b-117cd8f36f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:21.876721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3514a-05d6-4379-845b-117cd8f36f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:21.878173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3514a-05d6-4379-845b-117cd8f36f9c service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:21.887256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 696/1386] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:24.259300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf899b8-460d-4699-ba61-08b732b1b761 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:24.259808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf899b8-460d-4699-ba61-08b732b1b761 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:24.259808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf899b8-460d-4699-ba61-08b732b1b761 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:24.261588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 691/1387] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:24.267539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c054c24-4311-4e68-9b2c-bcd56dd9a222 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:24.267960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c054c24-4311-4e68-9b2c-bcd56dd9a222 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:24.268128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c054c24-4311-4e68-9b2c-bcd56dd9a222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:24.287343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1c054c24-4311-4e68-9b2c-bcd56dd9a222 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:24.288533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1c054c24-4311-4e68-9b2c-bcd56dd9a222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:24.296265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 697/1388] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:24.335246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf899b8-460d-4699-ba61-08b732b1b761 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:24.346094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf899b8-460d-4699-ba61-08b732b1b761 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:24.350230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d596b9-8599-4cf8-8115-a91cc59b35ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:24.350855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d596b9-8599-4cf8-8115-a91cc59b35ba service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:24.351136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d596b9-8599-4cf8-8115-a91cc59b35ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:24.351412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d596b9-8599-4cf8-8115-a91cc59b35ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:24.359975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d596b9-8599-4cf8-8115-a91cc59b35ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:24.361422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d596b9-8599-4cf8-8115-a91cc59b35ba service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:24.370746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 692/1389] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:26.954335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013fca-2ce4-4d9d-94d2-bff9bdcf786c None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.954881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013fca-2ce4-4d9d-94d2-bff9bdcf786c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.954881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013fca-2ce4-4d9d-94d2-bff9bdcf786c None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.956717 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 698/1390] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:26.962872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16470ab-54c4-476f-9928-0825f8f049f9 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:26.963282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16470ab-54c4-476f-9928-0825f8f049f9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:26.963423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16470ab-54c4-476f-9928-0825f8f049f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:26.982169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b16470ab-54c4-476f-9928-0825f8f049f9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:26.983391 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b16470ab-54c4-476f-9928-0825f8f049f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:26.991870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 693/1391] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:27.032323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba013fca-2ce4-4d9d-94d2-bff9bdcf786c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:27.043194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba013fca-2ce4-4d9d-94d2-bff9bdcf786c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:27.046624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbd292-c93d-427d-b9d5-ed62d133765e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:27.047254 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd292-c93d-427d-b9d5-ed62d133765e service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:27.047536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd292-c93d-427d-b9d5-ed62d133765e service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:27.047812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd292-c93d-427d-b9d5-ed62d133765e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:27.057153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbd292-c93d-427d-b9d5-ed62d133765e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:27.058600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbd292-c93d-427d-b9d5-ed62d133765e service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:27.069569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 699/1392] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:29.431204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8189-3998-49d8-b6c5-115feeb89924 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.431830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8189-3998-49d8-b6c5-115feeb89924 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.431830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a8189-3998-49d8-b6c5-115feeb89924 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.433578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 694/1393] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:29.439395 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc81a9-4420-41cd-a4e4-5b36406f1344 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.439794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc81a9-4420-41cd-a4e4-5b36406f1344 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.439950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc81a9-4420-41cd-a4e4-5b36406f1344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.457671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b9cc81a9-4420-41cd-a4e4-5b36406f1344 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:29.458901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b9cc81a9-4420-41cd-a4e4-5b36406f1344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:29.466688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 700/1394] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:29.506539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8189-3998-49d8-b6c5-115feeb89924 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:29.520746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a8189-3998-49d8-b6c5-115feeb89924 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:29.524310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfad16e-90c3-42d6-8656-10aaee6dc2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:29.524951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad16e-90c3-42d6-8656-10aaee6dc2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:29.525240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad16e-90c3-42d6-8656-10aaee6dc2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:29.525560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfad16e-90c3-42d6-8656-10aaee6dc2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:29.534256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad16e-90c3-42d6-8656-10aaee6dc2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:29.535737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfad16e-90c3-42d6-8656-10aaee6dc2a0 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:29.544847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 695/1395] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:31.822719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76630d-13c5-4084-8e06-42f89ea60824 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:31.823283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76630d-13c5-4084-8e06-42f89ea60824 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:31.823283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76630d-13c5-4084-8e06-42f89ea60824 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:31.825075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 701/1396] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:31.830859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186594-3998-4f78-bf09-acf91a133453 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:31.831267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186594-3998-4f78-bf09-acf91a133453 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:31.831939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186594-3998-4f78-bf09-acf91a133453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:31.850093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-38186594-3998-4f78-bf09-acf91a133453 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:31.851278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-38186594-3998-4f78-bf09-acf91a133453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:31.858923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 696/1397] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:31.897807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76630d-13c5-4084-8e06-42f89ea60824 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:31.908271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76630d-13c5-4084-8e06-42f89ea60824 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:31.912360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036cfb6-aa47-496b-94e8-1fe8e0548c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:31.912975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036cfb6-aa47-496b-94e8-1fe8e0548c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:31.913256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036cfb6-aa47-496b-94e8-1fe8e0548c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:31.913559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036cfb6-aa47-496b-94e8-1fe8e0548c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:31.921944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036cfb6-aa47-496b-94e8-1fe8e0548c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:31.923353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036cfb6-aa47-496b-94e8-1fe8e0548c4f service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:31.932712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 702/1398] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:34.210573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38b8a-84b4-4f4e-a652-a46c4668dc53 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:34.211169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38b8a-84b4-4f4e-a652-a46c4668dc53 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:34.211169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a38b8a-84b4-4f4e-a652-a46c4668dc53 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:34.213193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 697/1399] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:34.218998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf93d9d-db08-4c95-a18a-460da0c01141 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:34.219438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf93d9d-db08-4c95-a18a-460da0c01141 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:34.219555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf93d9d-db08-4c95-a18a-460da0c01141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:34.237039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-caf93d9d-db08-4c95-a18a-460da0c01141 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:34.238768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-caf93d9d-db08-4c95-a18a-460da0c01141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:34.246490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 703/1400] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:34.285993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a38b8a-84b4-4f4e-a652-a46c4668dc53 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:34.296501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a38b8a-84b4-4f4e-a652-a46c4668dc53 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:34.300566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c18ec3-d05d-4423-a0ce-29329824df74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:34.301193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18ec3-d05d-4423-a0ce-29329824df74 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:34.301507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18ec3-d05d-4423-a0ce-29329824df74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:34.301789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c18ec3-d05d-4423-a0ce-29329824df74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:34.310475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c18ec3-d05d-4423-a0ce-29329824df74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:34.311903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c18ec3-d05d-4423-a0ce-29329824df74 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:34.321588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 698/1401] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:36.685335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6a478-98d8-451b-accb-efce6a93030d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:36.685901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6a478-98d8-451b-accb-efce6a93030d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:36.685901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6a478-98d8-451b-accb-efce6a93030d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:36.687624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 704/1402] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:36.693615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f09355-455a-4028-b04a-900eac75e2bf None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:36.694018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f09355-455a-4028-b04a-900eac75e2bf None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:36.694186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f09355-455a-4028-b04a-900eac75e2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:36.712287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d6f09355-455a-4028-b04a-900eac75e2bf None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:36.713772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d6f09355-455a-4028-b04a-900eac75e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:36.721623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 699/1403] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:36.760287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6a478-98d8-451b-accb-efce6a93030d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:36.771414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6a478-98d8-451b-accb-efce6a93030d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:36.774862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d351d4a-15dc-4618-b426-814622e2967b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:36.775480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351d4a-15dc-4618-b426-814622e2967b service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:36.775782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351d4a-15dc-4618-b426-814622e2967b service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:36.776044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351d4a-15dc-4618-b426-814622e2967b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:36.785140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d351d4a-15dc-4618-b426-814622e2967b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:36.786598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d351d4a-15dc-4618-b426-814622e2967b service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:36.795490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 705/1404] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:39.073088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5b00-54c3-426d-aaa8-2ed990ed3158 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:39.073682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5b00-54c3-426d-aaa8-2ed990ed3158 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:39.073682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c5b00-54c3-426d-aaa8-2ed990ed3158 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:39.075478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 700/1405] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:39.082000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a039af-9c0f-4bff-81db-18ca0eceaa26 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:39.082450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a039af-9c0f-4bff-81db-18ca0eceaa26 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:39.082561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a039af-9c0f-4bff-81db-18ca0eceaa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:39.100598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d7a039af-9c0f-4bff-81db-18ca0eceaa26 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:39.101820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d7a039af-9c0f-4bff-81db-18ca0eceaa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:39.109488 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 706/1406] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:42:39.148403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5b00-54c3-426d-aaa8-2ed990ed3158 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:39.158700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c5b00-54c3-426d-aaa8-2ed990ed3158 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:39.162229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c6300-5d39-4411-a687-43528ac9e067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:39.162847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6300-5d39-4411-a687-43528ac9e067 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:39.163128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6300-5d39-4411-a687-43528ac9e067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:39.163400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c6300-5d39-4411-a687-43528ac9e067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:39.171855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c6300-5d39-4411-a687-43528ac9e067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:39.173265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c6300-5d39-4411-a687-43528ac9e067 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:39.182416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 701/1407] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:41.401261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed3b7-0868-4451-884e-3982166ecbb5 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.401826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed3b7-0868-4451-884e-3982166ecbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.401826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed3b7-0868-4451-884e-3982166ecbb5 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.403580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 707/1408] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:41.409999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450bff0-8e64-43de-90d4-e011d3350059 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.410410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450bff0-8e64-43de-90d4-e011d3350059 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.410561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450bff0-8e64-43de-90d4-e011d3350059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.428545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d450bff0-8e64-43de-90d4-e011d3350059 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:41.429779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d450bff0-8e64-43de-90d4-e011d3350059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:41.437453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 702/1409] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:41.474663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ed3b7-0868-4451-884e-3982166ecbb5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:41.484918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ed3b7-0868-4451-884e-3982166ecbb5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:41.488971 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403c689-c364-439d-a42a-8d7604da8eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:41.489624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c689-c364-439d-a42a-8d7604da8eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:41.489909 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c689-c364-439d-a42a-8d7604da8eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:41.490186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c689-c364-439d-a42a-8d7604da8eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:41.498662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403c689-c364-439d-a42a-8d7604da8eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:41.500069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403c689-c364-439d-a42a-8d7604da8eeb service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:41.509020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 708/1410] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:42:43.754292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395849ba-c276-43da-bf19-c4590727ef8d None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.754874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395849ba-c276-43da-bf19-c4590727ef8d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.754874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395849ba-c276-43da-bf19-c4590727ef8d None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.756622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 703/1411] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:42:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:42:43.762463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643cc7e-1bf9-4b4c-b734-04726ea2b8bc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.762854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643cc7e-1bf9-4b4c-b734-04726ea2b8bc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.763034 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643cc7e-1bf9-4b4c-b734-04726ea2b8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.780218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a643cc7e-1bf9-4b4c-b734-04726ea2b8bc None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:42:43.781442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a643cc7e-1bf9-4b4c-b734-04726ea2b8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:42:43.789640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 709/1412] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:42:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:42:43.827096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395849ba-c276-43da-bf19-c4590727ef8d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:42:43.837466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395849ba-c276-43da-bf19-c4590727ef8d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:42:43.841238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b4de6-884b-4746-92f3-5b4d7784668c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:42:43.841897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4de6-884b-4746-92f3-5b4d7784668c service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:42:43.842183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4de6-884b-4746-92f3-5b4d7784668c service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:42:43.842460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b4de6-884b-4746-92f3-5b4d7784668c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:42:43.851518 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4de6-884b-4746-92f3-5b4d7784668c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:42:43.852922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b4de6-884b-4746-92f3-5b4d7784668c service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:42:43.861942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 704/1413] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:42:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:43:00.626728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088c44-127c-45ed-8311-f7aedc10d2ce None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:00.627337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088c44-127c-45ed-8311-f7aedc10d2ce None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:00.627337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c088c44-127c-45ed-8311-f7aedc10d2ce None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:00.629571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 710/1414] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:43:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:00.635489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645e06f-1330-40e6-a64e-1f567c6a31f3 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:00.635950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645e06f-1330-40e6-a64e-1f567c6a31f3 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:00.636066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645e06f-1330-40e6-a64e-1f567c6a31f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:00.653914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d645e06f-1330-40e6-a64e-1f567c6a31f3 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:00.655098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d645e06f-1330-40e6-a64e-1f567c6a31f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:00.662778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 705/1415] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:00.712224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e57cc-40f9-4821-ab59-7ffe95bb8be2 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:00.712514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e57cc-40f9-4821-ab59-7ffe95bb8be2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:00.712795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e57cc-40f9-4821-ab59-7ffe95bb8be2 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:00.714872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 711/1416] 10.222.0.48 () {54 vars in 961 bytes} [Tue Oct 12 16:43:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:00.720114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a13a6-7b09-4bba-ac6e-be93d6a8d714 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:00.720410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a13a6-7b09-4bba-ac6e-be93d6a8d714 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:00.720698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a13a6-7b09-4bba-ac6e-be93d6a8d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:00.738789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-558a13a6-7b09-4bba-ac6e-be93d6a8d714 None None] MFA Rules not processed for user `6c767d4a9ad7459880884eb8c546dc55`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:00.739974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-558a13a6-7b09-4bba-ac6e-be93d6a8d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:00.747226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 706/1417] 10.222.0.48 () {58 vars in 1058 bytes} [Tue Oct 12 16:43:00 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:00.755482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e57cc-40f9-4821-ab59-7ffe95bb8be2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:00.765672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e57cc-40f9-4821-ab59-7ffe95bb8be2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:00.769796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117919-7975-4e09-bbba-dd3104688399 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c767d4a9ad7459880884eb8c546dc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:00.770412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117919-7975-4e09-bbba-dd3104688399 service glance] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:00.770699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117919-7975-4e09-bbba-dd3104688399 service glance] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:00.770978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117919-7975-4e09-bbba-dd3104688399 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:00.779479 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117919-7975-4e09-bbba-dd3104688399 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:00.780889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117919-7975-4e09-bbba-dd3104688399 service glance] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:00.790355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 712/1418] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:43:03.183612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544606e-2605-4111-883f-d3d3eee09563 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:03.184150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544606e-2605-4111-883f-d3d3eee09563 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:03.184267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544606e-2605-4111-883f-d3d3eee09563 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:03.186034 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 707/1419] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:43:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:03.192509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eeb3c-6b7c-4408-993d-0ec5332aed88 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:03.192977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eeb3c-6b7c-4408-993d-0ec5332aed88 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:03.193089 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7eeb3c-6b7c-4408-993d-0ec5332aed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:03.210434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-cb7eeb3c-6b7c-4408-993d-0ec5332aed88 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:03.211603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cb7eeb3c-6b7c-4408-993d-0ec5332aed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:03.219789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 713/1420] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:03.244149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544606e-2605-4111-883f-d3d3eee09563 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:03.256893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544606e-2605-4111-883f-d3d3eee09563 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:03.261228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07887335-c998-430e-b249-dd9ba84c1578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:03.261923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887335-c998-430e-b249-dd9ba84c1578 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:03.262206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887335-c998-430e-b249-dd9ba84c1578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:03.262482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07887335-c998-430e-b249-dd9ba84c1578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:03.263223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07887335-c998-430e-b249-dd9ba84c1578 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:03.265047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07887335-c998-430e-b249-dd9ba84c1578 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:03.278278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 708/1421] 10.222.0.48 () {56 vars in 1108 bytes} [Tue Oct 12 16:43:03 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:43:05.528319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0bf9-376c-4cc8-9f9e-bb483d8ae53f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:05.528879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0bf9-376c-4cc8-9f9e-bb483d8ae53f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:05.528879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0bf9-376c-4cc8-9f9e-bb483d8ae53f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:05.530723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 714/1422] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:43:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:05.536844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce6c0-0487-4645-b5f2-7bd7b389ff38 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:05.537267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce6c0-0487-4645-b5f2-7bd7b389ff38 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:05.537451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ce6c0-0487-4645-b5f2-7bd7b389ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:05.555457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1e4ce6c0-0487-4645-b5f2-7bd7b389ff38 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:05.556659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1e4ce6c0-0487-4645-b5f2-7bd7b389ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:05.564402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 709/1423] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:05.608683 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0bf9-376c-4cc8-9f9e-bb483d8ae53f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:05.623730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0bf9-376c-4cc8-9f9e-bb483d8ae53f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:05.629777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6f50a-6a56-476e-a0d9-3a90effdb3b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:05.630419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6f50a-6a56-476e-a0d9-3a90effdb3b9 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:05.631169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6f50a-6a56-476e-a0d9-3a90effdb3b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:05.631169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6f50a-6a56-476e-a0d9-3a90effdb3b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:05.639512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6f50a-6a56-476e-a0d9-3a90effdb3b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:05.641131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6f50a-6a56-476e-a0d9-3a90effdb3b9 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:05.650243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 715/1424] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:08.113811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a77d8-c222-47f0-b1af-abcd755e8732 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:08.114380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a77d8-c222-47f0-b1af-abcd755e8732 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:08.114380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a77d8-c222-47f0-b1af-abcd755e8732 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:08.116180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 710/1425] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:43:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:08.122190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733b768-46d2-43bd-a22d-6d1cb3ec4c8c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:08.122597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733b768-46d2-43bd-a22d-6d1cb3ec4c8c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:08.122787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733b768-46d2-43bd-a22d-6d1cb3ec4c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:08.141295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b733b768-46d2-43bd-a22d-6d1cb3ec4c8c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:08.142504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b733b768-46d2-43bd-a22d-6d1cb3ec4c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:08.150772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 716/1426] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:08.188444 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a77d8-c222-47f0-b1af-abcd755e8732 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:08.199466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a77d8-c222-47f0-b1af-abcd755e8732 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:08.203074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84611282-057d-429c-a02f-f34e74e62650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:08.203707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611282-057d-429c-a02f-f34e74e62650 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:08.204018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611282-057d-429c-a02f-f34e74e62650 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:08.204301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611282-057d-429c-a02f-f34e74e62650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:08.214216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84611282-057d-429c-a02f-f34e74e62650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:08.215661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84611282-057d-429c-a02f-f34e74e62650 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:08.225646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 711/1427] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:10.526117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527153-8fa0-488c-8655-2cb839999fcc None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:10.526695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527153-8fa0-488c-8655-2cb839999fcc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:10.526695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c527153-8fa0-488c-8655-2cb839999fcc None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:10.528510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 717/1428] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:43:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:10.535006 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bc4a-110d-4686-aac6-1f92534ec9e4 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:10.535431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bc4a-110d-4686-aac6-1f92534ec9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:10.535538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5bc4a-110d-4686-aac6-1f92534ec9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:10.553099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-27d5bc4a-110d-4686-aac6-1f92534ec9e4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:10.554320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-27d5bc4a-110d-4686-aac6-1f92534ec9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:10.562051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 712/1429] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:10.601469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527153-8fa0-488c-8655-2cb839999fcc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:10.612406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c527153-8fa0-488c-8655-2cb839999fcc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:10.615953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4b73-b30b-4908-aeb6-dd83b089a295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:10.616581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4b73-b30b-4908-aeb6-dd83b089a295 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:10.616870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4b73-b30b-4908-aeb6-dd83b089a295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:10.617153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4b73-b30b-4908-aeb6-dd83b089a295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:10.625904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4b73-b30b-4908-aeb6-dd83b089a295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:10.627358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4b73-b30b-4908-aeb6-dd83b089a295 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:10.636518 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 718/1430] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:43:12.945676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9658bb-7a1a-41c7-a155-13904da0ef25 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:12.946243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9658bb-7a1a-41c7-a155-13904da0ef25 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:12.946243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9658bb-7a1a-41c7-a155-13904da0ef25 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:12.947999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 713/1431] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:43:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:12.954042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a22b3e-f916-405c-90a7-97974cabc37f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:12.954475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a22b3e-f916-405c-90a7-97974cabc37f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:12.954585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a22b3e-f916-405c-90a7-97974cabc37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:12.973361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-06a22b3e-f916-405c-90a7-97974cabc37f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:12.974557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-06a22b3e-f916-405c-90a7-97974cabc37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:12.982155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 719/1432] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:13.024570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9658bb-7a1a-41c7-a155-13904da0ef25 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:13.036273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9658bb-7a1a-41c7-a155-13904da0ef25 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:13.039841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e18217-8961-41e9-ac97-b56c48c90140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:13.040495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18217-8961-41e9-ac97-b56c48c90140 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:13.040777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18217-8961-41e9-ac97-b56c48c90140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:13.041054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18217-8961-41e9-ac97-b56c48c90140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:13.049766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e18217-8961-41e9-ac97-b56c48c90140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:13.051199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e18217-8961-41e9-ac97-b56c48c90140 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:13.060239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 714/1433] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:43:15.505760 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d885a0-ff64-4773-b14e-2f3f296f3f50 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:15.506322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d885a0-ff64-4773-b14e-2f3f296f3f50 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:15.506322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d885a0-ff64-4773-b14e-2f3f296f3f50 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:15.508112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 720/1434] 10.222.0.48 () {54 vars in 926 bytes} [Tue Oct 12 16:43:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:43:15.514011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a437d5-8b61-4dd1-a896-669e0a1f1c65 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:15.514400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a437d5-8b61-4dd1-a896-669e0a1f1c65 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:15.514581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a437d5-8b61-4dd1-a896-669e0a1f1c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:15.532397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b0a437d5-8b61-4dd1-a896-669e0a1f1c65 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:43:15.533652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b0a437d5-8b61-4dd1-a896-669e0a1f1c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:43:15.541615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 715/1435] 10.222.0.48 () {58 vars in 1023 bytes} [Tue Oct 12 16:43:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:43:15.582392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d885a0-ff64-4773-b14e-2f3f296f3f50 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:43:15.593176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d885a0-ff64-4773-b14e-2f3f296f3f50 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:43:15.597234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb374771-bf43-428f-93c8-00ceec0ff09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:43:15.597892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374771-bf43-428f-93c8-00ceec0ff09a service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:43:15.598179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374771-bf43-428f-93c8-00ceec0ff09a service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:43:15.598455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374771-bf43-428f-93c8-00ceec0ff09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:43:15.607027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb374771-bf43-428f-93c8-00ceec0ff09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:43:15.608442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb374771-bf43-428f-93c8-00ceec0ff09a service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:43:15.618069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 721/1436] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:43:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:31.574350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49572f7-0f1a-48e8-8b24-e6d5594dced2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.574931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49572f7-0f1a-48e8-8b24-e6d5594dced2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.574931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49572f7-0f1a-48e8-8b24-e6d5594dced2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.593165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d49572f7-0f1a-48e8-8b24-e6d5594dced2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:31.594368 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d49572f7-0f1a-48e8-8b24-e6d5594dced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:31.601986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 716/1437] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:44:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:31.609681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e15ae2-93b3-4b18-a6c8-7a2241e505fe None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.610172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e15ae2-93b3-4b18-a6c8-7a2241e505fe None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.610850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e15ae2-93b3-4b18-a6c8-7a2241e505fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.628937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-13e15ae2-93b3-4b18-a6c8-7a2241e505fe None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:31.630146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-13e15ae2-93b3-4b18-a6c8-7a2241e505fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:31.637788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 722/1438] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:44:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:31.642479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49572f7-0f1a-48e8-8b24-e6d5594dced2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:31.651612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49572f7-0f1a-48e8-8b24-e6d5594dced2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:31.656054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:31.656691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.656973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.657290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.658103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:44:31.658349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:31.659916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:31.670854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 717/1439] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:44:31.679634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e15ae2-93b3-4b18-a6c8-7a2241e505fe None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:31.688377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e15ae2-93b3-4b18-a6c8-7a2241e505fe None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:31.693656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:31.694301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.694589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.694864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.695564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:31.697464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:31.731637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 723/1440] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:44:31 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:44:31.736242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:31.745821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6c33-32f5-488d-8856-9fc180cae94e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:31.799476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:31.800134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.800422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.800702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.801432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:31.803361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:31.822110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 718/1441] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:44:31 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:44:31.825914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:31.835591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2a4ba-1fbc-4ba5-8a04-9899bb5886e8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:31.840341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:31.840995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.841286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.841602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.842373 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:31.843968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:31.856793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 724/1442] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:44:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:44:31.861175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:31.870655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe41b0-66bf-4098-800f-a27e6b9f880e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:31.875165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88691233-d975-462a-ae04-abfcce21cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:31.875816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691233-d975-462a-ae04-abfcce21cfef admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.876744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691233-d975-462a-ae04-abfcce21cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.877057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88691233-d975-462a-ae04-abfcce21cfef admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.877790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691233-d975-462a-ae04-abfcce21cfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:31.879363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88691233-d975-462a-ae04-abfcce21cfef admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:31.892273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 719/1443] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:44:31 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:44:31.896398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:31.905927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef99547-8e38-490a-b621-8e00cd282231 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:31.910482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:31.911343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.911631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.911912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] PATH_INFO: `/v3/projects/9ed238e3b4c949f29d0af26182cab748/users/ba403d5977964396a09d1e47a49ae404/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.926504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed238e3b4c949f29d0af26182cab748, user_id=ba403d5977964396a09d1e47a49ae404, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:31.929173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:31.942502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 725/1444] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:44:31 2021] PUT /identity/v3/projects/9ed238e3b4c949f29d0af26182cab748/users/ba403d5977964396a09d1e47a49ae404/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:44:31.954332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe65377-07d7-4129-bdd8-4ee543dfc67d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:31.954628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe65377-07d7-4129-bdd8-4ee543dfc67d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:31.954918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe65377-07d7-4129-bdd8-4ee543dfc67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:31.980536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-bbe65377-07d7-4129-bdd8-4ee543dfc67d None None] MFA Rules not processed for user `ba403d5977964396a09d1e47a49ae404`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:31.981781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bbe65377-07d7-4129-bdd8-4ee543dfc67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:32.043033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 720/1445] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:44:31 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:32.055376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:32.127144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52973db-25da-43ef-8c12-de6a46b6151e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:32.132502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:32.133150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:32.133468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:32.133755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:32.141333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:32.143005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:32.151604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 726/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:32 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:32.222661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6549-f690-4ac8-a27f-d3d24000bb6e None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:32.222952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6549-f690-4ac8-a27f-d3d24000bb6e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:32.223231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c6549-f690-4ac8-a27f-d3d24000bb6e None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:32.224925 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 721/1447] 10.222.0.48 () {52 vars in 829 bytes} [Tue Oct 12 16:44:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:44:32.228525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:32.287058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e99d2-c7a8-4f48-8228-a717096509f5 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:32.291488 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:32.292331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:32.292612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:32.292887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] PATH_INFO: `/v3/users/ba403d5977964396a09d1e47a49ae404` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:32.294067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba403d5977964396a09d1e47a49ae404)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:32.295072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:44:32.295072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:44:32.295072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:44:32.296266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:32.359547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba403d5977964396a09d1e47a49ae404'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:32.368668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba403d5977964396a09d1e47a49ae404'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:32.380558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba403d5977964396a09d1e47a49ae404'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:32.381228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba403d5977964396a09d1e47a49ae404'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:32.400391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba403d5977964396a09d1e47a49ae404'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:32.406192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 727/1448] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:44:32 2021] DELETE /identity/v3/users/ba403d5977964396a09d1e47a49ae404 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:44:32.411329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:32.411651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:32.411932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:32.428568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:44:32.429801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:32.486646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 722/1449] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:44:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:44:32.496449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:32.497883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:32.555215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987bb8b-4a74-4f23-9520-d5669a04cb66 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:32.558817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb922236-8a86-45d8-8b6f-91837c83281b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:32.559456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb922236-8a86-45d8-8b6f-91837c83281b service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:32.559744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb922236-8a86-45d8-8b6f-91837c83281b service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:32.560024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb922236-8a86-45d8-8b6f-91837c83281b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:32.569209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb922236-8a86-45d8-8b6f-91837c83281b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:32.570674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb922236-8a86-45d8-8b6f-91837c83281b service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:32.579701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 728/1450] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:44:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:44:32.927115 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:44:32.929344 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:44:32.940888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce7026-98ab-4094-ba89-2ccf1af76da2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:44:32.947725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:44:32.947725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:44:32.947725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:44:32.947725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] PATH_INFO: `/v3/projects/9ed238e3b4c949f29d0af26182cab748` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:44:32.948612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed238e3b4c949f29d0af26182cab748)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:44:32.949661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:44:32.949661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:44:32.949661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:44:32.950990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:44:33.013468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed238e3b4c949f29d0af26182cab748', 'request_id': 'req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:33.022809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed238e3b4c949f29d0af26182cab748', 'request_id': 'req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:33.036753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed238e3b4c949f29d0af26182cab748', 'request_id': 'req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:33.047223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] The token cache is being invalidate because project 9ed238e3b4c949f29d0af26182cab748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:44:33.047514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:33.048816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-feb8d1f1-ed7e-4f3e-b2fb-f73ee564626e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:44:33.050560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 723/1451] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:44:32 2021] DELETE /identity/v3/projects/9ed238e3b4c949f29d0af26182cab748 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:46:08.831014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cdd05-cd21-4386-b78d-d7eef83c1984 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:08.831582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cdd05-cd21-4386-b78d-d7eef83c1984 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:08.831582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cdd05-cd21-4386-b78d-d7eef83c1984 None None] PATH_INFO: `/v3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:08.832802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 729/1452] 10.222.0.25 () {54 vars in 925 bytes} [Tue Oct 12 16:46:08 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:46:08.840232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003fdd-b69e-436c-a9ff-83bc6752c822 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:08.840697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003fdd-b69e-436c-a9ff-83bc6752c822 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:08.840803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8003fdd-b69e-436c-a9ff-83bc6752c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:08.858883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f8003fdd-b69e-436c-a9ff-83bc6752c822 None None] MFA Rules not processed for user `32dbbc4af72f4d11a9b1876dba8e886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:08.860093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f8003fdd-b69e-436c-a9ff-83bc6752c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:08.918965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 724/1453] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 12 16:46:08 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:08.963684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625092-573c-498f-85f6-552bbe39ff2f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:08.963979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625092-573c-498f-85f6-552bbe39ff2f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:08.964263 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af625092-573c-498f-85f6-552bbe39ff2f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:08.966567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:46:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:08.971866 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132cd99-aec2-4ee2-987c-4bb80e96c29e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:08.972162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132cd99-aec2-4ee2-987c-4bb80e96c29e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:08.972448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132cd99-aec2-4ee2-987c-4bb80e96c29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:08.991218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1132cd99-aec2-4ee2-987c-4bb80e96c29e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:08.992419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1132cd99-aec2-4ee2-987c-4bb80e96c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:09.050052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:46:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:09.205410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af625092-573c-498f-85f6-552bbe39ff2f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:09.207003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-af625092-573c-498f-85f6-552bbe39ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:09.277337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af625092-573c-498f-85f6-552bbe39ff2f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:09.282718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e89e6-e55f-4c19-987a-836e7a816838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:09.283356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e89e6-e55f-4c19-987a-836e7a816838 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:09.283640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e89e6-e55f-4c19-987a-836e7a816838 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:09.283918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e89e6-e55f-4c19-987a-836e7a816838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:09.292262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e89e6-e55f-4c19-987a-836e7a816838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:09.293869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e89e6-e55f-4c19-987a-836e7a816838 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:09.302748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 731/1456] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:10.721019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd6df-6ea0-48c8-945e-7cc16cd01c2e None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:10.721604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd6df-6ea0-48c8-945e-7cc16cd01c2e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:10.721708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfd6df-6ea0-48c8-945e-7cc16cd01c2e None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:10.724060 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:46:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:10.729234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4cd66-d194-486c-8774-60518850bc3f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:10.729726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4cd66-d194-486c-8774-60518850bc3f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:10.729830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4cd66-d194-486c-8774-60518850bc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:10.747290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c8b4cd66-d194-486c-8774-60518850bc3f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:10.748481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c8b4cd66-d194-486c-8774-60518850bc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:10.756164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:46:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:10.909261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfd6df-6ea0-48c8-945e-7cc16cd01c2e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:10.923065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfd6df-6ea0-48c8-945e-7cc16cd01c2e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:10.928467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bd29e-ae15-45f8-be59-0ff34599cc89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:10.929104 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd29e-ae15-45f8-be59-0ff34599cc89 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:10.929412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd29e-ae15-45f8-be59-0ff34599cc89 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:10.929693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd29e-ae15-45f8-be59-0ff34599cc89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:10.937762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bd29e-ae15-45f8-be59-0ff34599cc89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:10.939352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bd29e-ae15-45f8-be59-0ff34599cc89 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:10.949023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 727/1459] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:17.315573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c6f51-7c42-4d95-b64f-526089b033cb None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:17.316025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c6f51-7c42-4d95-b64f-526089b033cb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:17.316230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c6f51-7c42-4d95-b64f-526089b033cb None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:17.318759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 733/1460] 10.222.0.48 () {54 vars in 960 bytes} [Tue Oct 12 16:46:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:17.324040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2722d2-8fb9-40bf-b8f3-a375447a2798 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:17.324450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2722d2-8fb9-40bf-b8f3-a375447a2798 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:17.324596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2722d2-8fb9-40bf-b8f3-a375447a2798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:17.342656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-4d2722d2-8fb9-40bf-b8f3-a375447a2798 None None] MFA Rules not processed for user `32dbbc4af72f4d11a9b1876dba8e886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:17.343715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4d2722d2-8fb9-40bf-b8f3-a375447a2798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:17.352996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 728/1461] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Oct 12 16:46:17 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:17.360681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c6f51-7c42-4d95-b64f-526089b033cb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:17.374165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c6f51-7c42-4d95-b64f-526089b033cb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:17.379096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d464f6d-013d-4e88-9ecb-488786b5f483 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:17.380449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464f6d-013d-4e88-9ecb-488786b5f483 service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:17.380696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464f6d-013d-4e88-9ecb-488786b5f483 service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:17.380981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464f6d-013d-4e88-9ecb-488786b5f483 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:17.389014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d464f6d-013d-4e88-9ecb-488786b5f483 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:17.390627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d464f6d-013d-4e88-9ecb-488786b5f483 service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:17.400022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 734/1462] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:17 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:22.745875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee644a-68ca-4a31-84fa-d462e1288e82 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:22.746450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee644a-68ca-4a31-84fa-d462e1288e82 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:22.746450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee644a-68ca-4a31-84fa-d462e1288e82 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:22.748262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:46:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:22.753499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bb91b-9ada-4934-ac5d-f1aaca799b86 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:22.753903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bb91b-9ada-4934-ac5d-f1aaca799b86 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:22.754070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bb91b-9ada-4934-ac5d-f1aaca799b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:22.772117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-634bb91b-9ada-4934-ac5d-f1aaca799b86 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:22.773312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-634bb91b-9ada-4934-ac5d-f1aaca799b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:22.781076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:46:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:22.936983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee644a-68ca-4a31-84fa-d462e1288e82 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:22.950937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee644a-68ca-4a31-84fa-d462e1288e82 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:22.956376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766dcc5-7669-4c01-b3d3-8e96104a7292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:22.957011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dcc5-7669-4c01-b3d3-8e96104a7292 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:22.957300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dcc5-7669-4c01-b3d3-8e96104a7292 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:22.957610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766dcc5-7669-4c01-b3d3-8e96104a7292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:22.965774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766dcc5-7669-4c01-b3d3-8e96104a7292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:22.967400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766dcc5-7669-4c01-b3d3-8e96104a7292 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:22.976995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 730/1465] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:24.385070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d081ef8-5fe9-4933-b5f1-304cd5b93e6b None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:24.385686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d081ef8-5fe9-4933-b5f1-304cd5b93e6b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:24.385686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d081ef8-5fe9-4933-b5f1-304cd5b93e6b None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:24.387452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 12 16:46:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:24.392961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39962d-ab61-4fa8-96e0-886fef319ed1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:24.393430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39962d-ab61-4fa8-96e0-886fef319ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:24.393738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39962d-ab61-4fa8-96e0-886fef319ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:24.411663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1f39962d-ab61-4fa8-96e0-886fef319ed1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:24.412841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1f39962d-ab61-4fa8-96e0-886fef319ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:24.420453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 12 16:46:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:24.578718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d081ef8-5fe9-4933-b5f1-304cd5b93e6b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:24.593015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d081ef8-5fe9-4933-b5f1-304cd5b93e6b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:24.598993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a883-c7b6-4f7f-a201-e1aa16767755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:24.599626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a883-c7b6-4f7f-a201-e1aa16767755 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:24.599916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a883-c7b6-4f7f-a201-e1aa16767755 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:24.600198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a883-c7b6-4f7f-a201-e1aa16767755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:24.608038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a883-c7b6-4f7f-a201-e1aa16767755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:24.609733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a883-c7b6-4f7f-a201-e1aa16767755 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:24.619337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 737/1468] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:29.396113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59295-5e7a-4c1e-b0f8-f215c90d41d4 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:29.396675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59295-5e7a-4c1e-b0f8-f215c90d41d4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:29.396675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59295-5e7a-4c1e-b0f8-f215c90d41d4 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:29.398481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:46:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:29.404221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dfc02-1307-4381-aa65-7ff21ce23398 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:29.404632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dfc02-1307-4381-aa65-7ff21ce23398 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:29.404823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dfc02-1307-4381-aa65-7ff21ce23398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:29.424332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fd2dfc02-1307-4381-aa65-7ff21ce23398 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:29.425556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fd2dfc02-1307-4381-aa65-7ff21ce23398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:29.433758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:46:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:29.472404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59295-5e7a-4c1e-b0f8-f215c90d41d4 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:29.474099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a0e59295-5e7a-4c1e-b0f8-f215c90d41d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:29.528093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59295-5e7a-4c1e-b0f8-f215c90d41d4 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:29.531746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b271cd3-c2f6-40d5-bb6a-c7f3a75f3380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:29.532371 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271cd3-c2f6-40d5-bb6a-c7f3a75f3380 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:29.532654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271cd3-c2f6-40d5-bb6a-c7f3a75f3380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:29.532929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271cd3-c2f6-40d5-bb6a-c7f3a75f3380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:29.541550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b271cd3-c2f6-40d5-bb6a-c7f3a75f3380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:29.542957 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b271cd3-c2f6-40d5-bb6a-c7f3a75f3380 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:29.551981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 733/1471] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:31.753560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694f7f-04bf-4c99-92ce-85f8a87dc6ac None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:31.754241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694f7f-04bf-4c99-92ce-85f8a87dc6ac None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:31.754241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694f7f-04bf-4c99-92ce-85f8a87dc6ac None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:31.755966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 739/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:46:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:31.762166 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28289fa-7256-4cbf-a79d-cd441c161a91 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:31.762574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28289fa-7256-4cbf-a79d-cd441c161a91 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:31.762723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28289fa-7256-4cbf-a79d-cd441c161a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:31.780109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a28289fa-7256-4cbf-a79d-cd441c161a91 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:31.781326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a28289fa-7256-4cbf-a79d-cd441c161a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:31.789020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 734/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:46:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:31.826390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19694f7f-04bf-4c99-92ce-85f8a87dc6ac None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:31.836809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19694f7f-04bf-4c99-92ce-85f8a87dc6ac None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:31.840591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca5f5c-cdd2-4c6b-9357-848b4143458c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:31.841224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5f5c-cdd2-4c6b-9357-848b4143458c service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:31.841533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5f5c-cdd2-4c6b-9357-848b4143458c service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:31.841816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca5f5c-cdd2-4c6b-9357-848b4143458c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:31.850935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca5f5c-cdd2-4c6b-9357-848b4143458c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:31.852344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca5f5c-cdd2-4c6b-9357-848b4143458c service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:31.861321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 740/1474] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:35.799874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d57b4-f77c-436a-be7d-fe67e89383af None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.800443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d57b4-f77c-436a-be7d-fe67e89383af None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.800443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d57b4-f77c-436a-be7d-fe67e89383af None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.802219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 735/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:46:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:35.807908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a584-8dcd-48fb-83eb-6e7bcf066fa7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.808352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a584-8dcd-48fb-83eb-6e7bcf066fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.808478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34a584-8dcd-48fb-83eb-6e7bcf066fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.826852 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ff34a584-8dcd-48fb-83eb-6e7bcf066fa7 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:35.828027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ff34a584-8dcd-48fb-83eb-6e7bcf066fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:35.836287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 741/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:46:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:46:35.888126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d57b4-f77c-436a-be7d-fe67e89383af None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:35.889819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-cf2d57b4-f77c-436a-be7d-fe67e89383af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:35.944838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d57b4-f77c-436a-be7d-fe67e89383af None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:35.948393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92079bff-c167-4947-836b-d0bc233e3d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:35.949064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079bff-c167-4947-836b-d0bc233e3d45 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:35.949352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079bff-c167-4947-836b-d0bc233e3d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:35.949674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079bff-c167-4947-836b-d0bc233e3d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:35.958330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92079bff-c167-4947-836b-d0bc233e3d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:35.960439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92079bff-c167-4947-836b-d0bc233e3d45 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:35.969836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 736/1477] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:46:38.201015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb5d3-078e-4393-ad87-9086d86b63d1 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:38.201630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb5d3-078e-4393-ad87-9086d86b63d1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:38.201630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb5d3-078e-4393-ad87-9086d86b63d1 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:38.203421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 742/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Oct 12 16:46:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:38.209678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c422a-7cf0-40a9-9a3c-a43e851ae168 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:38.210112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c422a-7cf0-40a9-9a3c-a43e851ae168 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:38.210257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c422a-7cf0-40a9-9a3c-a43e851ae168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:38.228443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-570c422a-7cf0-40a9-9a3c-a43e851ae168 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:38.229682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-570c422a-7cf0-40a9-9a3c-a43e851ae168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:38.237531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 737/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Oct 12 16:46:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:38.288666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e32f2-1dfe-48bf-8ce6-df0f8829c094 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:38.288884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e32f2-1dfe-48bf-8ce6-df0f8829c094 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:38.289165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e32f2-1dfe-48bf-8ce6-df0f8829c094 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:38.290962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 743/1480] 10.222.0.48 () {54 vars in 962 bytes} [Tue Oct 12 16:46:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:46:38.296160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df1ede-bc49-4166-a32c-a525a8139ced None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:38.296457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df1ede-bc49-4166-a32c-a525a8139ced None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:38.296742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df1ede-bc49-4166-a32c-a525a8139ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:38.314583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-43df1ede-bc49-4166-a32c-a525a8139ced None None] MFA Rules not processed for user `9e128ed2736b4158ae2009df5ba23fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:46:38.315763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-43df1ede-bc49-4166-a32c-a525a8139ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:46:38.322162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 738/1481] 10.222.0.48 () {58 vars in 1059 bytes} [Tue Oct 12 16:46:38 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:46:38.329852 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e32f2-1dfe-48bf-8ce6-df0f8829c094 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:46:38.340898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e32f2-1dfe-48bf-8ce6-df0f8829c094 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:46:38.344445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b022e-6be9-49de-bdd3-b87c8a9ee3aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:46:38.345056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b022e-6be9-49de-bdd3-b87c8a9ee3aa service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:46:38.345339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b022e-6be9-49de-bdd3-b87c8a9ee3aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:46:38.345644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b022e-6be9-49de-bdd3-b87c8a9ee3aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:46:38.354819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b022e-6be9-49de-bdd3-b87c8a9ee3aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:46:38.356221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b022e-6be9-49de-bdd3-b87c8a9ee3aa service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:46:38.365321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 744/1482] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:46:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:00.345551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee6d9-358a-41d0-9502-10d42533806f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.346162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee6d9-358a-41d0-9502-10d42533806f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.346162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fee6d9-358a-41d0-9502-10d42533806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.367151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a6fee6d9-358a-41d0-9502-10d42533806f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.368276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819864-69c1-4e6f-a02a-2834ecc27e25 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.368772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a6fee6d9-358a-41d0-9502-10d42533806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.369491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819864-69c1-4e6f-a02a-2834ecc27e25 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.369976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819864-69c1-4e6f-a02a-2834ecc27e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.385721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 739/1483] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.394684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50f5b-6286-478c-b0f0-9865d184ad15 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.395117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50f5b-6286-478c-b0f0-9865d184ad15 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.395405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50f5b-6286-478c-b0f0-9865d184ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.401365 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8e819864-69c1-4e6f-a02a-2834ecc27e25 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.403118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8e819864-69c1-4e6f-a02a-2834ecc27e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.425356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 745/1484] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.435192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2accc3-8119-4850-9f6b-abf92e60e0b9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.435757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2accc3-8119-4850-9f6b-abf92e60e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.436239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2accc3-8119-4850-9f6b-abf92e60e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.439302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f8c50f5b-6286-478c-b0f0-9865d184ad15 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.440814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f8c50f5b-6286-478c-b0f0-9865d184ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.455180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 740/1485] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:00.460320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c50f5b-6286-478c-b0f0-9865d184ad15 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.470376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0d2accc3-8119-4850-9f6b-abf92e60e0b9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.471882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0d2accc3-8119-4850-9f6b-abf92e60e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.475972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c50f5b-6286-478c-b0f0-9865d184ad15 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.489668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.490264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 746/1486] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.490395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.490665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.491574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.492458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:00.492775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.494774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.496044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2accc3-8119-4850-9f6b-abf92e60e0b9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.509982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2accc3-8119-4850-9f6b-abf92e60e0b9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.511552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 741/1487] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:48:00.520170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.522655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.523553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.524029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.524535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.525727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:00.526239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.528041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.537916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b112f-98e4-43f3-a5e0-d404b8f95d60 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.546061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b79a13-79e2-4e6e-8205-a6fcb9675e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.546741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79a13-79e2-4e6e-8205-a6fcb9675e0c admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.547094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79a13-79e2-4e6e-8205-a6fcb9675e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.547309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b79a13-79e2-4e6e-8205-a6fcb9675e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.551858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b79a13-79e2-4e6e-8205-a6fcb9675e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.551858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b79a13-79e2-4e6e-8205-a6fcb9675e0c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.552658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 747/1488] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:00.559673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.570297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b84ff4-d0f7-486d-8ee5-f5d61958501a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.581020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.582078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.582618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.583126 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.584060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.586249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.620302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 742/1489] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:00.621763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0043a-2dfa-4097-a701-504c7baf8a6b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.622063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0043a-2dfa-4097-a701-504c7baf8a6b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.622345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0043a-2dfa-4097-a701-504c7baf8a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.638186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 748/1490] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:00.639492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.661922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0bb0043a-2dfa-4097-a701-504c7baf8a6b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.663703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0bb0043a-2dfa-4097-a701-504c7baf8a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.730762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0e93f-e9c8-4926-ab39-6c9306336d21 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.746535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615262e-26e5-42ba-9e27-3e64a1d065f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.747572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615262e-26e5-42ba-9e27-3e64a1d065f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.748079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615262e-26e5-42ba-9e27-3e64a1d065f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.748547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615262e-26e5-42ba-9e27-3e64a1d065f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.749499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615262e-26e5-42ba-9e27-3e64a1d065f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.751819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615262e-26e5-42ba-9e27-3e64a1d065f4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.770409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 743/1491] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.771693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0043a-2dfa-4097-a701-504c7baf8a6b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.782551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 749/1492] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:00.784009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008be7f1-0663-405d-b95d-c473b42a03fa None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.784379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008be7f1-0663-405d-b95d-c473b42a03fa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.784867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008be7f1-0663-405d-b95d-c473b42a03fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.786585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0043a-2dfa-4097-a701-504c7baf8a6b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.793903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f063686-484a-45c8-aeff-c97619b9ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.794852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063686-484a-45c8-aeff-c97619b9ea37 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.795331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063686-484a-45c8-aeff-c97619b9ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.795794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f063686-484a-45c8-aeff-c97619b9ea37 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.796715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f063686-484a-45c8-aeff-c97619b9ea37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.799707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f063686-484a-45c8-aeff-c97619b9ea37 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.804483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-008be7f1-0663-405d-b95d-c473b42a03fa None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.805783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-008be7f1-0663-405d-b95d-c473b42a03fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.814480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 750/1493] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.816036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf580ba-39f7-42c7-a811-e93489d0a001 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.816036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf580ba-39f7-42c7-a811-e93489d0a001 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.816400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf580ba-39f7-42c7-a811-e93489d0a001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.828044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 744/1494] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/users => generated 282 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:00.830464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115329-c30d-4531-a8fb-f341648cfd3f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.831494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115329-c30d-4531-a8fb-f341648cfd3f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.832200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115329-c30d-4531-a8fb-f341648cfd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.843778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4bf580ba-39f7-42c7-a811-e93489d0a001 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.845124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4bf580ba-39f7-42c7-a811-e93489d0a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.853937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 751/1495] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.854890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-32115329-c30d-4531-a8fb-f341648cfd3f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.855485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1d3c7-cd80-4940-86b7-fca7176ff3e8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.855853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1d3c7-cd80-4940-86b7-fca7176ff3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.856209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1d3c7-cd80-4940-86b7-fca7176ff3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.857166 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-32115329-c30d-4531-a8fb-f341648cfd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.871250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 745/1496] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.872469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32115329-c30d-4531-a8fb-f341648cfd3f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.877808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-68b1d3c7-cd80-4940-86b7-fca7176ff3e8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.879047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-68b1d3c7-cd80-4940-86b7-fca7176ff3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.884614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32115329-c30d-4531-a8fb-f341648cfd3f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.888150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 752/1497] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.888968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1d3c7-cd80-4940-86b7-fca7176ff3e8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.889309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb420d-226a-476b-9874-206bdec70b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.890182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb420d-226a-476b-9874-206bdec70b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.890481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb420d-226a-476b-9874-206bdec70b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.890762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb420d-226a-476b-9874-206bdec70b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.891661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb420d-226a-476b-9874-206bdec70b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.893396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bb420d-226a-476b-9874-206bdec70b32 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.904521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1d3c7-cd80-4940-86b7-fca7176ff3e8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.904717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 746/1498] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:00 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:00.906181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5854da-25cc-457c-ace5-70d5b0413a7c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.906479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5854da-25cc-457c-ace5-70d5b0413a7c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.906763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5854da-25cc-457c-ace5-70d5b0413a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.911889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd543f-9ae6-4c38-8393-e64507c2ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.912598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd543f-9ae6-4c38-8393-e64507c2ebb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.912892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd543f-9ae6-4c38-8393-e64507c2ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.913176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd543f-9ae6-4c38-8393-e64507c2ebb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.914087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd543f-9ae6-4c38-8393-e64507c2ebb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.915722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd543f-9ae6-4c38-8393-e64507c2ebb0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.926247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2e5854da-25cc-457c-ace5-70d5b0413a7c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.927378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 753/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:00 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:00.927570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2e5854da-25cc-457c-ace5-70d5b0413a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.929295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d0a9-9963-4438-9d8a-07eb5858ea26 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.929479 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d0a9-9963-4438-9d8a-07eb5858ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.929702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4d0a9-9963-4438-9d8a-07eb5858ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.936975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 747/1500] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.938335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb5e63-2d54-4a7e-9f80-4c2780f59328 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.938631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb5e63-2d54-4a7e-9f80-4c2780f59328 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.938914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb5e63-2d54-4a7e-9f80-4c2780f59328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.948090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fee4d0a9-9963-4438-9d8a-07eb5858ea26 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.949285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fee4d0a9-9963-4438-9d8a-07eb5858ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.956776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-04cb5e63-2d54-4a7e-9f80-4c2780f59328 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.957287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 754/1501] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.961198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-04cb5e63-2d54-4a7e-9f80-4c2780f59328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.961290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc355a0-46e9-4718-b2ef-ec39d581ba93 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.961290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc355a0-46e9-4718-b2ef-ec39d581ba93 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.961290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc355a0-46e9-4718-b2ef-ec39d581ba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.966499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 748/1502] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.967275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb5e63-2d54-4a7e-9f80-4c2780f59328 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:00.976715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb5e63-2d54-4a7e-9f80-4c2780f59328 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:00.980216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6dc355a0-46e9-4718-b2ef-ec39d581ba93 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:00.981338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00378447-2d72-4a24-b0c9-021eef284796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:00.981487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6dc355a0-46e9-4718-b2ef-ec39d581ba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:00.982010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00378447-2d72-4a24-b0c9-021eef284796 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:00.982298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00378447-2d72-4a24-b0c9-021eef284796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:00.982701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00378447-2d72-4a24-b0c9-021eef284796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:00.983436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00378447-2d72-4a24-b0c9-021eef284796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:00.983745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00378447-2d72-4a24-b0c9-021eef284796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:00.985331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00378447-2d72-4a24-b0c9-021eef284796 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:00.989148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 755/1503] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:00.989974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc355a0-46e9-4718-b2ef-ec39d581ba93 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.000009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 749/1504] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:01.000009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ea509-5f14-4501-b581-9e1e554f2782 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.000250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc355a0-46e9-4718-b2ef-ec39d581ba93 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.000352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ea509-5f14-4501-b581-9e1e554f2782 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.000443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ea509-5f14-4501-b581-9e1e554f2782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.005175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.005871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.006183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.007155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.008770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.009537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.018536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-842ea509-5f14-4501-b581-9e1e554f2782 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:01.022625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 756/1505] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:01.022765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-842ea509-5f14-4501-b581-9e1e554f2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:01.022903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.028943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 750/1506] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:01.029772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ea509-5f14-4501-b581-9e1e554f2782 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.031715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63892695-13ed-4bcd-996c-80bec120482b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.036895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.038146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.038469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.038749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.039589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.040428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ea509-5f14-4501-b581-9e1e554f2782 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.041305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.045205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.045883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.046173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.046448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.047186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:01.047490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.049062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.051577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 757/1507] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:01.052424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.062579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc35a9-9a2f-41e8-8413-05e5f77375c2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.063327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 751/1508] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:01.064211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.067246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88678b99-2c2f-4527-9552-27c165f763f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.067891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678b99-2c2f-4527-9552-27c165f763f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.068178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678b99-2c2f-4527-9552-27c165f763f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.068457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88678b99-2c2f-4527-9552-27c165f763f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.069230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88678b99-2c2f-4527-9552-27c165f763f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:01.069560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88678b99-2c2f-4527-9552-27c165f763f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.071559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88678b99-2c2f-4527-9552-27c165f763f8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.074145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b51e0-702c-4771-8b9a-fa3ef05d9725 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.078773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.079538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.079830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.080109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.080844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:01.081152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.082766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.083716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 758/1509] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:01.085117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77530885-e2e6-4e63-9413-775677f8cd2d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.085438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77530885-e2e6-4e63-9413-775677f8cd2d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.085726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77530885-e2e6-4e63-9413-775677f8cd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.099112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 752/1510] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:01.099112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.106428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700bdb-0fad-4a7f-aebb-5c24583def6f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.108499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-77530885-e2e6-4e63-9413-775677f8cd2d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:01.109722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-77530885-e2e6-4e63-9413-775677f8cd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:01.111477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465af852-ef11-4ee3-a54d-7119cbb38708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.112123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af852-ef11-4ee3-a54d-7119cbb38708 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.112414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af852-ef11-4ee3-a54d-7119cbb38708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.112695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465af852-ef11-4ee3-a54d-7119cbb38708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.113456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465af852-ef11-4ee3-a54d-7119cbb38708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.115409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465af852-ef11-4ee3-a54d-7119cbb38708 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.118203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 759/1511] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:01.118942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77530885-e2e6-4e63-9413-775677f8cd2d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.130354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77530885-e2e6-4e63-9413-775677f8cd2d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.135793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.136663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.136947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.137234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] PATH_INFO: `/v3/projects/8d690d5366234c8dbfbc35443567b4b6/users/1c7dc34241604829bcb49a23e42c0190/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.144324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 753/1512] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.144324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae339d-c1b2-495c-9ece-0c5c8c9ab513 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.144324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae339d-c1b2-495c-9ece-0c5c8c9ab513 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.144324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae339d-c1b2-495c-9ece-0c5c8c9ab513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.151456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d690d5366234c8dbfbc35443567b4b6, user_id=1c7dc34241604829bcb49a23e42c0190, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.154284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.160514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f5ae339d-c1b2-495c-9ece-0c5c8c9ab513 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:01.161895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f5ae339d-c1b2-495c-9ece-0c5c8c9ab513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:01.168720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 760/1513] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:01 2021] PUT /identity/v3/projects/8d690d5366234c8dbfbc35443567b4b6/users/1c7dc34241604829bcb49a23e42c0190/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:01.169511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.227703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6181-d4e5-4265-9edd-2771915225b8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.228732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 754/1514] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:01.229589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae339d-c1b2-495c-9ece-0c5c8c9ab513 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.232731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.233659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.233956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.234240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] PATH_INFO: `/v3/projects/0d8108f782d14245807c45a1c81e025f/users/b4699fa07892493c958be897f133f9e0/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.238713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae339d-c1b2-495c-9ece-0c5c8c9ab513 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.244421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.245174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.245596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.246057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.246840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.248753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.249015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8108f782d14245807c45a1c81e025f, user_id=b4699fa07892493c958be897f133f9e0, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.251722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.265096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 761/1515] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:01 2021] PUT /identity/v3/projects/0d8108f782d14245807c45a1c81e025f/users/b4699fa07892493c958be897f133f9e0/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:01.265908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.278484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 755/1516] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.279286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.324456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410f0b9-1ec0-4873-b452-51608c5590eb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.336661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31481d26-ff21-4853-9fbb-36052560e3cb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.341569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.342217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.342504 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.342817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.343545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.345446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.373773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 756/1517] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.374597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.383729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.384336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.384628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.384911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.385718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.387630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.416353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 762/1518] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/projects => generated 403 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.416353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.434093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fefa-63bf-43c7-bb07-34fd7c1618e9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.472985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e84eef-e23b-4969-86b9-7f6d97b55a57 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.478313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1d250-19bf-469b-bb43-73bdd24214ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.478979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d250-19bf-469b-bb43-73bdd24214ce admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.479289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d250-19bf-469b-bb43-73bdd24214ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.479554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1d250-19bf-469b-bb43-73bdd24214ce admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.480262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1d250-19bf-469b-bb43-73bdd24214ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.482211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1d250-19bf-469b-bb43-73bdd24214ce admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.487198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.487851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.488133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.488408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.489129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:01.489463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.491061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.501508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 763/1519] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.502846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d138e14-a9fe-4b7f-a307-deeceb6a115a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.503133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d138e14-a9fe-4b7f-a307-deeceb6a115a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.503417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d138e14-a9fe-4b7f-a307-deeceb6a115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.503761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 757/1520] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:01.505158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.514577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d1f89-ffc9-432e-9dd3-713b583e7c49 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.519331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4382a02-e994-4dee-9073-5061fb18aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.519959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382a02-e994-4dee-9073-5061fb18aa96 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.520243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382a02-e994-4dee-9073-5061fb18aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.520519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4382a02-e994-4dee-9073-5061fb18aa96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.521242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4382a02-e994-4dee-9073-5061fb18aa96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:01.521589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4382a02-e994-4dee-9073-5061fb18aa96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.523744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4382a02-e994-4dee-9073-5061fb18aa96 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.530304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1d138e14-a9fe-4b7f-a307-deeceb6a115a None None] MFA Rules not processed for user `1c7dc34241604829bcb49a23e42c0190`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:01.531528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1d138e14-a9fe-4b7f-a307-deeceb6a115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:01.535748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 758/1521] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:01.536995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463efca0-3140-44a3-bc80-cf84ef9029e7 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.537281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463efca0-3140-44a3-bc80-cf84ef9029e7 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.538250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463efca0-3140-44a3-bc80-cf84ef9029e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.562692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-463efca0-3140-44a3-bc80-cf84ef9029e7 None None] MFA Rules not processed for user `b4699fa07892493c958be897f133f9e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:01.563930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-463efca0-3140-44a3-bc80-cf84ef9029e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:01.593936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 764/1522] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:01.594830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d138e14-a9fe-4b7f-a307-deeceb6a115a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.606149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d138e14-a9fe-4b7f-a307-deeceb6a115a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.611591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.612262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.612547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.612831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.613568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.615540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.631176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 759/1523] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:01.632025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463efca0-3140-44a3-bc80-cf84ef9029e7 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.636270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 765/1524] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.637092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.642249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463efca0-3140-44a3-bc80-cf84ef9029e7 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.646710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b80d59-5a34-4024-8998-0d4600c21507 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.647503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.648154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.648436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.648713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.649439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.651343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.651757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.652399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.652686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.652965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.653691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.655559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.674792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 760/1525] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/users => generated 284 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.674792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.681293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 766/1526] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.681293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.681762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bb81a-d63e-4b7e-9464-1a2136786841 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.686252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.686887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.687169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.687441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.688157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.688744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1e4a-4f30-4da0-9a83-b2f59b67a7a6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.689770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.693273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219fc64-f1ba-4972-96f0-cd8c388bb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.693960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219fc64-f1ba-4972-96f0-cd8c388bb519 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.694244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219fc64-f1ba-4972-96f0-cd8c388bb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.694525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219fc64-f1ba-4972-96f0-cd8c388bb519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.695218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219fc64-f1ba-4972-96f0-cd8c388bb519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.697075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219fc64-f1ba-4972-96f0-cd8c388bb519 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.702254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 761/1527] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:01.702254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.708802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e54f81-e3fb-43b9-9587-04e2710cfac1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.713858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.714473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.714752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.715094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.716142 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.718207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.725977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 767/1528] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.727437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea4e5-2d2c-4721-8a74-f19ea857dc2d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.727738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea4e5-2d2c-4721-8a74-f19ea857dc2d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.728073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea4e5-2d2c-4721-8a74-f19ea857dc2d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.729742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 768/1529] 10.222.0.48 () {54 vars in 960 bytes} [Tue Oct 12 16:48:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:01.730431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea4e5-2d2c-4721-8a74-f19ea857dc2d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.748476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 762/1530] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.750294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.790976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea4e5-2d2c-4721-8a74-f19ea857dc2d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.808227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abfe2-20e3-4ff4-819f-5d3ce8c72887 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.812910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.813601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.813889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.814172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.814899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.816595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.826194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 763/1531] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:01.826986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.836271 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ffd59-7b2a-4d80-936c-483ab3ed8692 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.841528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.842170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.842459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.842768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.843497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.845095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.845213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.845944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.846303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.846653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.847433 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.849315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.858826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 764/1532] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:01.858826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.865337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614741bd-914d-4dae-adcd-3ae9deeceef2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.870679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.871948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.872231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.873108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.873872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.878732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 769/1533] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.878886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.878983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.885346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 765/1534] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:01.886011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.895485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a596b-6edd-4959-bdd6-e25dcf090a86 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.935222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81482f21-744b-4018-8587-b9fd31d1e901 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.940487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f234-3dad-4af2-8ab7-bf23f8045aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.941153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f234-3dad-4af2-8ab7-bf23f8045aee admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.941476 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f234-3dad-4af2-8ab7-bf23f8045aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.941758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f234-3dad-4af2-8ab7-bf23f8045aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.942526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1f234-3dad-4af2-8ab7-bf23f8045aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.944119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1f234-3dad-4af2-8ab7-bf23f8045aee admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.949645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.950309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.950593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.950900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.951628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.953534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:01.954475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 770/1535] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:01 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:01.955719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f4d8e-2ecd-4a0a-abd2-222bbd58f942 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.955999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f4d8e-2ecd-4a0a-abd2-222bbd58f942 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.956282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f4d8e-2ecd-4a0a-abd2-222bbd58f942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.976053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 766/1536] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:01.976053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:01.976388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1c5f4d8e-2ecd-4a0a-abd2-222bbd58f942 None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:01.976943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1c5f4d8e-2ecd-4a0a-abd2-222bbd58f942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:01.982907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9f625-e33c-42c1-a420-1986f264bb09 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:01.988541 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:01.989217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:01.989542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:01.989823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:01.990568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:01.993030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.011921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 767/1537] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/users => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:02.012937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.022139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ec01-5ebf-49ae-9f75-9a7a242c197d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.026738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.027370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.027654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.027932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.028648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.030243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.041696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 768/1538] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.042659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.048461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 771/1539] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Oct 12 16:48:01 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:02.050318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f4d8e-2ecd-4a0a-abd2-222bbd58f942 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.054443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59fc6-c9dc-4e86-a63f-ea33add666dc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.059562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.060201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.060482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.060757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.060853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f4d8e-2ecd-4a0a-abd2-222bbd58f942 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.061513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.063073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.065432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.066077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.066367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.066647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.067364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.069269 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.072675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 769/1540] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.076706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.086967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8abdb1-7507-4e64-8f40-e6c9ff7c59e1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.093101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 772/1541] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:02 2021] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:02.093101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.094989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.095632 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.095921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.096200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.096922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.098529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.100777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720fa84-2573-416e-ae8e-a325df6d3bac admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.105418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.106274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.106563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.106845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] PATH_INFO: `/v3/projects/1e3793eca5f44becb0da2d9372080d65/users/b24c2c2de0d9467791de67e2c93ae0b2/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.111847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 770/1542] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.111847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.119431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73065-175f-4274-b3aa-7385d62e3bc2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.121802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3793eca5f44becb0da2d9372080d65, user_id=b24c2c2de0d9467791de67e2c93ae0b2, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.123954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.124471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.124601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.124847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.125123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.125878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.127412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.141229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 773/1543] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:02 2021] PUT /identity/v3/projects/1e3793eca5f44becb0da2d9372080d65/users/b24c2c2de0d9467791de67e2c93ae0b2/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:02.141450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 771/1544] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.141450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.141632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.151644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd85cc-e894-4522-8bfd-3a8bee85319a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.198957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be9102-807d-484e-b728-e9d31292c479 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.203349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.203583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.204236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.204371 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.204521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.204623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.204802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.204895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] PATH_INFO: `/v3/projects/bcc9dc092411436db420dbd261c512fb/users/494090a6abb8483eb0f5bf354c219ad6/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.205578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.207282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.217822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 774/1545] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.218703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.220010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc9dc092411436db420dbd261c512fb, user_id=494090a6abb8483eb0f5bf354c219ad6, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.222940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.237448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 772/1546] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:02 2021] PUT /identity/v3/projects/bcc9dc092411436db420dbd261c512fb/users/494090a6abb8483eb0f5bf354c219ad6/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:02.247462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.286250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6f27-4e0c-4764-a9e5-e50f2e469794 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.303896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50291b5e-5449-46f7-9569-0064a2b4cf9a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.308562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.309496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.309787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.310063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] PATH_INFO: `/v3/projects/86d9dfd66b6646c5b8245f4954896b15/users/0a39650a52c4417bbe08ac06dc4219dd/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.323928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d9dfd66b6646c5b8245f4954896b15, user_id=0a39650a52c4417bbe08ac06dc4219dd, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.326609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.340141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 773/1547] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:02 2021] PUT /identity/v3/projects/86d9dfd66b6646c5b8245f4954896b15/users/0a39650a52c4417bbe08ac06dc4219dd/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:02.349662 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.353245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.354123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.354416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.354701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.406567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f716-776c-4ef8-b237-15effc3dae59 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.407682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.409286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.411186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d87b7-543e-493d-8ebc-f50eea592602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.411845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d87b7-543e-493d-8ebc-f50eea592602 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.412132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d87b7-543e-493d-8ebc-f50eea592602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.412950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d87b7-543e-493d-8ebc-f50eea592602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.413723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d87b7-543e-493d-8ebc-f50eea592602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.415290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d87b7-543e-493d-8ebc-f50eea592602 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.418600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 775/1548] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:02.419375 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.424924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 774/1549] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.426192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af27a6-18f1-412c-9d49-dc6fcd0b123a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.426475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af27a6-18f1-412c-9d49-dc6fcd0b123a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.426761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af27a6-18f1-412c-9d49-dc6fcd0b123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.429490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d661-9368-4145-a832-26679f2fb887 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.434211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.435079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.435372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.435678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] PATH_INFO: `/v3/projects/8f3ad851e3a040a79398b4b2d0f835e2/users/53c47306cf5d4bbda26bbe9c1413f832/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.444186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a9af27a6-18f1-412c-9d49-dc6fcd0b123a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:02.445441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a9af27a6-18f1-412c-9d49-dc6fcd0b123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:02.450214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3ad851e3a040a79398b4b2d0f835e2, user_id=53c47306cf5d4bbda26bbe9c1413f832, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.452890 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.453457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 775/1550] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:02.454031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af27a6-18f1-412c-9d49-dc6fcd0b123a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.466908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af27a6-18f1-412c-9d49-dc6fcd0b123a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.483065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 776/1551] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:02 2021] PUT /identity/v3/projects/8f3ad851e3a040a79398b4b2d0f835e2/users/53c47306cf5d4bbda26bbe9c1413f832/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:02.483065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.523646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a7ac0-1e69-4c06-89e7-0b4f20443504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.524593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a7ac0-1e69-4c06-89e7-0b4f20443504 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.525029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a7ac0-1e69-4c06-89e7-0b4f20443504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.525532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a7ac0-1e69-4c06-89e7-0b4f20443504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.526437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a7ac0-1e69-4c06-89e7-0b4f20443504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.528303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a7ac0-1e69-4c06-89e7-0b4f20443504 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.540077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 776/1552] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.541603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2821db-b563-408b-94c9-13c40689971b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.542049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2821db-b563-408b-94c9-13c40689971b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.542483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2821db-b563-408b-94c9-13c40689971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.547566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164ca64-6fba-4d89-ab2d-2a7da6fc35a5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.552671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cc401-8f75-432f-9bac-cba45feda56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.553949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc401-8f75-432f-9bac-cba45feda56d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.554241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc401-8f75-432f-9bac-cba45feda56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.554528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc401-8f75-432f-9bac-cba45feda56d admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.555276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cc401-8f75-432f-9bac-cba45feda56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.556913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cc401-8f75-432f-9bac-cba45feda56d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.567193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 777/1553] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:02.571297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f899c-7809-41d3-b1a8-2ac5474cc08d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.571810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f899c-7809-41d3-b1a8-2ac5474cc08d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.572063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9a2821db-b563-408b-94c9-13c40689971b None None] MFA Rules not processed for user `494090a6abb8483eb0f5bf354c219ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:02.572293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f899c-7809-41d3-b1a8-2ac5474cc08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.573296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9a2821db-b563-408b-94c9-13c40689971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:02.597878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a55f899c-7809-41d3-b1a8-2ac5474cc08d None None] MFA Rules not processed for user `0a39650a52c4417bbe08ac06dc4219dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:02.599179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a55f899c-7809-41d3-b1a8-2ac5474cc08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:02.636338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 777/1554] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:02 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:02.637308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2821db-b563-408b-94c9-13c40689971b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.650965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2821db-b563-408b-94c9-13c40689971b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.656000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83475e-2132-44b8-b539-4bcf434914e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.657762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83475e-2132-44b8-b539-4bcf434914e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.657762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83475e-2132-44b8-b539-4bcf434914e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.657762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83475e-2132-44b8-b539-4bcf434914e8 admin admin] PATH_INFO: `/v3/projects/8df014c940b64f6ab42d42d2f4a1cde0/users/0bf05e9c7f67490ba56571b634670867/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.673131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 778/1555] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:02 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:02.673131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f899c-7809-41d3-b1a8-2ac5474cc08d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.674340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83475e-2132-44b8-b539-4bcf434914e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df014c940b64f6ab42d42d2f4a1cde0, user_id=0bf05e9c7f67490ba56571b634670867, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.677087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83475e-2132-44b8-b539-4bcf434914e8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.691278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 778/1556] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:02 2021] PUT /identity/v3/projects/8df014c940b64f6ab42d42d2f4a1cde0/users/0bf05e9c7f67490ba56571b634670867/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:02.692619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87353-9cc0-4d87-92a8-a21945c6e54d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.692912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87353-9cc0-4d87-92a8-a21945c6e54d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.693190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b87353-9cc0-4d87-92a8-a21945c6e54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.719028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f3b87353-9cc0-4d87-92a8-a21945c6e54d None None] MFA Rules not processed for user `53c47306cf5d4bbda26bbe9c1413f832`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:02.720223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f3b87353-9cc0-4d87-92a8-a21945c6e54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:02.728884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f899c-7809-41d3-b1a8-2ac5474cc08d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.774999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.775651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.775941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.776227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.781966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 779/1557] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:02 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:02.782760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87353-9cc0-4d87-92a8-a21945c6e54d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.833227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.834745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.841284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b87353-9cc0-4d87-92a8-a21945c6e54d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.844439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 779/1558] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:02.845196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.846192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44653c5-cf5e-4d10-acfa-4a3ebde1fcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.847078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44653c5-cf5e-4d10-acfa-4a3ebde1fcb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.847475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44653c5-cf5e-4d10-acfa-4a3ebde1fcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.847765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44653c5-cf5e-4d10-acfa-4a3ebde1fcb7 admin admin] PATH_INFO: `/v3/projects/ea06ba2e773d42f1ab5ae2a60f8dd8d6/users/80558ff481cc4871b5f3f361c42edd17/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.854989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2fe2a-64ad-4cac-81b0-7d6c3a4df603 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.859790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.860671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.860962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.861243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] PATH_INFO: `/v3/projects/bef38560185b407ea90862e9626f9afc/users/6363ee6ea7c441ccbd9d8dc5ab30cebe/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.863503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44653c5-cf5e-4d10-acfa-4a3ebde1fcb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea06ba2e773d42f1ab5ae2a60f8dd8d6, user_id=80558ff481cc4871b5f3f361c42edd17, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.866890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44653c5-cf5e-4d10-acfa-4a3ebde1fcb7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.878694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef38560185b407ea90862e9626f9afc, user_id=6363ee6ea7c441ccbd9d8dc5ab30cebe, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.881592 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.882306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 780/1559] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:02 2021] PUT /identity/v3/projects/ea06ba2e773d42f1ab5ae2a60f8dd8d6/users/80558ff481cc4871b5f3f361c42edd17/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:02.883690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dd04b-72a8-4343-849e-8591cce8ffd2 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.883984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dd04b-72a8-4343-849e-8591cce8ffd2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.884266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dd04b-72a8-4343-849e-8591cce8ffd2 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.886011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 781/1560] 10.222.0.48 () {54 vars in 960 bytes} [Tue Oct 12 16:48:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:02.886713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dd04b-72a8-4343-849e-8591cce8ffd2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.902199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 780/1561] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:02 2021] PUT /identity/v3/projects/bef38560185b407ea90862e9626f9afc/users/6363ee6ea7c441ccbd9d8dc5ab30cebe/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:02.903476 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:02.948217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dd04b-72a8-4343-849e-8591cce8ffd2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.976221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4f7e-382f-42ad-9365-36eed47b3978 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:02.982160 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361557e-6222-4cd6-a42b-71c18025d52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.983120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361557e-6222-4cd6-a42b-71c18025d52b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.983473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361557e-6222-4cd6-a42b-71c18025d52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:02.983822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361557e-6222-4cd6-a42b-71c18025d52b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:02.984712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361557e-6222-4cd6-a42b-71c18025d52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:02.986885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361557e-6222-4cd6-a42b-71c18025d52b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:02.998667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3442d7b-8d3e-4ad3-8303-57bf94f329b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:02.999320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3442d7b-8d3e-4ad3-8303-57bf94f329b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:02.999609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3442d7b-8d3e-4ad3-8303-57bf94f329b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.000058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3442d7b-8d3e-4ad3-8303-57bf94f329b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.001759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 781/1562] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:03.006290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562dd46-d5e1-49bc-94db-5f3d94a8ef56 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.006589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562dd46-d5e1-49bc-94db-5f3d94a8ef56 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.006874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562dd46-d5e1-49bc-94db-5f3d94a8ef56 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.008754 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 782/1563] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 12 16:48:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:03.009298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562dd46-d5e1-49bc-94db-5f3d94a8ef56 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.024082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562dd46-d5e1-49bc-94db-5f3d94a8ef56 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.043714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ca8b0-2ce7-4c50-809e-ea290a87c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.044528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca8b0-2ce7-4c50-809e-ea290a87c5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.044817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca8b0-2ce7-4c50-809e-ea290a87c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.045096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca8b0-2ce7-4c50-809e-ea290a87c5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.045845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ca8b0-2ce7-4c50-809e-ea290a87c5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.047866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ca8b0-2ce7-4c50-809e-ea290a87c5a9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.073769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3442d7b-8d3e-4ad3-8303-57bf94f329b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.074481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 783/1564] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:03 2021] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:03.075706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c755829-5a00-48ed-be72-263f4fd117f0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.076021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c755829-5a00-48ed-be72-263f4fd117f0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.076298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3442d7b-8d3e-4ad3-8303-57bf94f329b3 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.076419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c755829-5a00-48ed-be72-263f4fd117f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.086197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 782/1565] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:02 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:03.087358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b9ef6-62a6-47a4-bc9b-3a56f6323571 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.087648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b9ef6-62a6-47a4-bc9b-3a56f6323571 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.087930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b9ef6-62a6-47a4-bc9b-3a56f6323571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.094625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9c755829-5a00-48ed-be72-263f4fd117f0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:03.095837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9c755829-5a00-48ed-be72-263f4fd117f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:03.107751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-105b9ef6-62a6-47a4-bc9b-3a56f6323571 None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:03.109036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-105b9ef6-62a6-47a4-bc9b-3a56f6323571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:03.155892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 784/1566] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:03.160016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f73aa-6c3b-4797-b1d1-9def3269069f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.160310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f73aa-6c3b-4797-b1d1-9def3269069f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.160590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f73aa-6c3b-4797-b1d1-9def3269069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.178628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d81f73aa-6c3b-4797-b1d1-9def3269069f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:03.179829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d81f73aa-6c3b-4797-b1d1-9def3269069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:03.185537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 783/1567] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Oct 12 16:48:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:03.186357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b9ef6-62a6-47a4-bc9b-3a56f6323571 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.191391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 785/1568] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:03.193020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e27bf-800b-4673-b5ea-c2cf0c59c76c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.193404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e27bf-800b-4673-b5ea-c2cf0c59c76c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.193797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e27bf-800b-4673-b5ea-c2cf0c59c76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.198974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b9ef6-62a6-47a4-bc9b-3a56f6323571 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.213461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-bf5e27bf-800b-4673-b5ea-c2cf0c59c76c None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:03.213593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.214532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.214895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.215114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bf5e27bf-800b-4673-b5ea-c2cf0c59c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:03.215289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] PATH_INFO: `/v3/projects/8df014c940b64f6ab42d42d2f4a1cde0/users/0bf05e9c7f67490ba56571b634670867/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.217981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df014c940b64f6ab42d42d2f4a1cde0, user_id=0bf05e9c7f67490ba56571b634670867, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.221168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.227031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 786/1569] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:48:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:03.227953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e27bf-800b-4673-b5ea-c2cf0c59c76c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.233722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 784/1570] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:03 2021] PUT /identity/v3/projects/8df014c940b64f6ab42d42d2f4a1cde0/users/0bf05e9c7f67490ba56571b634670867/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:03.234752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.236417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:03.257816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e27bf-800b-4673-b5ea-c2cf0c59c76c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.321016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178d360-b9a6-4a4f-8f7d-e7335efeb25b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.326334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.326997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.327285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.327613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.331403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.332199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.332580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.332952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.333914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.336805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.338684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.339217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.350654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 785/1571] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:03.351394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.366079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 787/1572] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:03 2021] POST /identity/v3/users => generated 309 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:03.367233 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.380436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fe48b-be76-4ed1-9b53-6d9390edeff9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.386335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.387621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.388292 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.388746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.401639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.403208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.414407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 788/1573] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:03.416250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.447980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e292a04-d22d-4b64-bcd0-dfd8f8802f44 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.455890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.457053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.457568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.457970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.488590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d69dff-afe5-42de-9d78-b1df5f19d293 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.493881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28c591-4036-470f-bcb9-c880bda9bd61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.495796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28c591-4036-470f-bcb9-c880bda9bd61 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.496167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28c591-4036-470f-bcb9-c880bda9bd61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.496525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28c591-4036-470f-bcb9-c880bda9bd61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.512974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28c591-4036-470f-bcb9-c880bda9bd61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.515838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28c591-4036-470f-bcb9-c880bda9bd61 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.532326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 789/1574] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:03.534270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db7dd-078d-43cc-8971-b963e5deedbb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.534674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db7dd-078d-43cc-8971-b963e5deedbb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.535055 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1db7dd-078d-43cc-8971-b963e5deedbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.554350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.556586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.569740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 786/1575] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:03 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:03.571260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.585246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c262-42d8-409c-817d-020952ec46d2 service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.593968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.594999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.595559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.596449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.597457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.599434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.607869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6c1db7dd-078d-43cc-8971-b963e5deedbb None None] MFA Rules not processed for user `0bf05e9c7f67490ba56571b634670867`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:03.609619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6c1db7dd-078d-43cc-8971-b963e5deedbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:03.613715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 787/1576] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:03 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:03.618107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.640125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614053a8-a32c-4dff-a00f-5615ea8f06d4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.649036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.650299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.651037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.651548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] PATH_INFO: `/v3/projects/69289f03e5074f9d9c01f4d104f03004/users/df526e68cd814acf8acc518b15d0109c/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.691203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69289f03e5074f9d9c01f4d104f03004, user_id=df526e68cd814acf8acc518b15d0109c, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.694582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.730809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 788/1577] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:03 2021] PUT /identity/v3/projects/69289f03e5074f9d9c01f4d104f03004/users/df526e68cd814acf8acc518b15d0109c/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:03.737491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.781665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 790/1578] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:03 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:03.788255 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db7dd-078d-43cc-8971-b963e5deedbb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.811325 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1db7dd-078d-43cc-8971-b963e5deedbb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.893659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544041-3205-49b1-bd41-fcecd0ee211d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.899812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.900647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.901066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.901996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.902926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.904953 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.918241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2fe63-2790-4ea7-8b72-cb7538feafe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.922735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 789/1579] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:03 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:03.922925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2fe63-2790-4ea7-8b72-cb7538feafe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.922925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2fe63-2790-4ea7-8b72-cb7538feafe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.922925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2fe63-2790-4ea7-8b72-cb7538feafe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.930103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:03.942591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd6a01-d1eb-4ba3-978d-6c617fd13264 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:03.948377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:03.949046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:03.949969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:03.950270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] PATH_INFO: `/v3/projects/69289f03e5074f9d9c01f4d104f03004/users/df526e68cd814acf8acc518b15d0109c/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:03.952420 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69289f03e5074f9d9c01f4d104f03004, user_id=df526e68cd814acf8acc518b15d0109c, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:03.955261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:03.968895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 790/1580] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:03 2021] PUT /identity/v3/projects/69289f03e5074f9d9c01f4d104f03004/users/df526e68cd814acf8acc518b15d0109c/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:03.970056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:04.036626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2fe63-2790-4ea7-8b72-cb7538feafe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:04.039856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2fe63-2790-4ea7-8b72-cb7538feafe6 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:04.054154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 791/1581] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:03 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:04.055563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bf96-87e6-4549-9698-1ad84eb23b1e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.055865 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bf96-87e6-4549-9698-1ad84eb23b1e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.056208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19bf96-87e6-4549-9698-1ad84eb23b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.059613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cceb4-8ae1-40e9-9fe3-647f262e6204 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:04.069668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:04.071773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.073128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.074554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] PATH_INFO: `/v3/users/1c7dc34241604829bcb49a23e42c0190` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.076525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7dc34241604829bcb49a23e42c0190)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:04.078244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: WARNING py.warnings [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:48:04.078244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: warnings.warn(msg) Oct 12 16:48:04.078244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: Oct 12 16:48:04.079711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:04.087134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3b19bf96-87e6-4549-9698-1ad84eb23b1e None None] MFA Rules not processed for user `df526e68cd814acf8acc518b15d0109c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:04.089759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3b19bf96-87e6-4549-9698-1ad84eb23b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.169318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7dc34241604829bcb49a23e42c0190'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:04.170125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7dc34241604829bcb49a23e42c0190'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:04.184413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7dc34241604829bcb49a23e42c0190'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:04.193456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 792/1582] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:04 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:04.194870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2793fe-5674-4b7c-a512-88d3d19f6156 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.195148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2793fe-5674-4b7c-a512-88d3d19f6156 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.195431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2793fe-5674-4b7c-a512-88d3d19f6156 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.197419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 793/1583] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 12 16:48:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:04.198121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2793fe-5674-4b7c-a512-88d3d19f6156 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:04.199745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3e2793fe-5674-4b7c-a512-88d3d19f6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.211974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7dc34241604829bcb49a23e42c0190'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:04.213354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6e058a3d-d9f0-438a-ade9-e15aa705dd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7dc34241604829bcb49a23e42c0190'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:04.256683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 791/1584] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:03 2021] DELETE /identity/v3/users/1c7dc34241604829bcb49a23e42c0190 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:04.259321 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.260045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.260635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.275521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2793fe-5674-4b7c-a512-88d3d19f6156 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:04.287830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:04.289824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.355408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e24f7e-d7e6-405f-af84-d8d320bbbfa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:04.356595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24f7e-d7e6-405f-af84-d8d320bbbfa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.357206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24f7e-d7e6-405f-af84-d8d320bbbfa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.357722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e24f7e-d7e6-405f-af84-d8d320bbbfa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.361403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f5e24f7e-d7e6-405f-af84-d8d320bbbfa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.408223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 792/1585] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:48:04 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:04.409431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:04.411137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.423906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dc586-d299-4ff9-ad8b-8e69f91c93c3 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:04.428354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1900b44-8af6-4489-9fcd-b8ba5c8300ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:04.429210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900b44-8af6-4489-9fcd-b8ba5c8300ca service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.429717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900b44-8af6-4489-9fcd-b8ba5c8300ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.430178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1900b44-8af6-4489-9fcd-b8ba5c8300ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.468552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e24f7e-d7e6-405f-af84-d8d320bbbfa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:04.472082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e24f7e-d7e6-405f-af84-d8d320bbbfa0 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:04.494965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 794/1586] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:04 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:04.499202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.499674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.499840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.512376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1900b44-8af6-4489-9fcd-b8ba5c8300ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:04.513888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1900b44-8af6-4489-9fcd-b8ba5c8300ca service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:04.531384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:04.532621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.538942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 793/1587] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:04 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:04.541233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05aced-fa2f-40b1-ba8f-03fcf5077051 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.541695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05aced-fa2f-40b1-ba8f-03fcf5077051 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.541982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05aced-fa2f-40b1-ba8f-03fcf5077051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.606587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 795/1588] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:04.620182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-cc05aced-fa2f-40b1-ba8f-03fcf5077051 None None] MFA Rules not processed for user `b24c2c2de0d9467791de67e2c93ae0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:04.620781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:04.623007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.624358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-cc05aced-fa2f-40b1-ba8f-03fcf5077051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.765824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 794/1589] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:04 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:04.768118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05aced-fa2f-40b1-ba8f-03fcf5077051 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:04.796966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05aced-fa2f-40b1-ba8f-03fcf5077051 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:04.802126 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965999cd-9520-40a5-a0f4-b1e43a8df907 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:04.809343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767148d4-ee56-4659-b874-af268506deb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:04.810232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767148d4-ee56-4659-b874-af268506deb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.810619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767148d4-ee56-4659-b874-af268506deb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.811583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767148d4-ee56-4659-b874-af268506deb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.813530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:04.815842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.816331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.816820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.842069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767148d4-ee56-4659-b874-af268506deb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:04.842069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767148d4-ee56-4659-b874-af268506deb3 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:04.842323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:04.844821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:04.858836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 795/1590] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:04.866074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 796/1591] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:04.874133 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:04.875379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:04.875898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:04.925560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] MFA Rules not processed for user `b24c2c2de0d9467791de67e2c93ae0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:04.929286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.944575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 796/1592] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:04 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:04.967488 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:04.969643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:04.998375 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54519dcc-6ef7-468f-be71-6f48650fa32d service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:05.010786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f77df0-c9a7-4566-a9c5-2bf0b0ea6100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:05.011310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77df0-c9a7-4566-a9c5-2bf0b0ea6100 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:05.011655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77df0-c9a7-4566-a9c5-2bf0b0ea6100 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:05.011934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77df0-c9a7-4566-a9c5-2bf0b0ea6100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:05.024985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f77df0-c9a7-4566-a9c5-2bf0b0ea6100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:05.026985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f77df0-c9a7-4566-a9c5-2bf0b0ea6100 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:05.066388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:05.067466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 797/1593] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:04 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:05.072210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:05.106202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce221a0-012f-4217-93a5-b0016a9bffb5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:05.124311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:05.125801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:05.126475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:05.127309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] PATH_INFO: `/v3/users/53c47306cf5d4bbda26bbe9c1413f832` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:05.129201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c47306cf5d4bbda26bbe9c1413f832)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:05.133010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:05.255275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c47306cf5d4bbda26bbe9c1413f832'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:05.256628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c47306cf5d4bbda26bbe9c1413f832'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:05.269914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c47306cf5d4bbda26bbe9c1413f832'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:05.281337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c47306cf5d4bbda26bbe9c1413f832'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:05.283151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c47306cf5d4bbda26bbe9c1413f832'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:05.305421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 797/1594] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:05 2021] DELETE /identity/v3/users/53c47306cf5d4bbda26bbe9c1413f832 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:05.310268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d976ba-2d3b-465d-a011-d6a9ff6ef3db None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:05.310565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d976ba-2d3b-465d-a011-d6a9ff6ef3db None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:05.310866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d976ba-2d3b-465d-a011-d6a9ff6ef3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:05.333869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-58d976ba-2d3b-465d-a011-d6a9ff6ef3db None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:05.336054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-58d976ba-2d3b-465d-a011-d6a9ff6ef3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:05.491611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 798/1595] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:05.533022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:05.537119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:05.631431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c9c3-bea5-4e08-b65f-0dd060a9a111 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:05.635697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba3e99-84bb-41be-9561-8c77cdca614f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:05.636615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3e99-84bb-41be-9561-8c77cdca614f service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:05.637098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3e99-84bb-41be-9561-8c77cdca614f service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:05.637540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3e99-84bb-41be-9561-8c77cdca614f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:05.650083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba3e99-84bb-41be-9561-8c77cdca614f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:05.652235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba3e99-84bb-41be-9561-8c77cdca614f service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:05.668062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 798/1596] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:05.813127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7ee92-3576-4338-96d4-6670a299b31d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:05.813469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7ee92-3576-4338-96d4-6670a299b31d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:05.813755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7ee92-3576-4338-96d4-6670a299b31d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:05.816203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 799/1597] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 12 16:48:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:05.826823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:05.827119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:05.829427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:05.885094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] MFA Rules not processed for user `671f4f6ff7d84739aecf74e53bb1aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:05.887019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:05.910532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 799/1598] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:48:05 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:05.928116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7ee92-3576-4338-96d4-6670a299b31d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:05.944059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7ee92-3576-4338-96d4-6670a299b31d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:05.952072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a5504-2df1-4a4c-b420-ee165d31ebc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:05.953280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5504-2df1-4a4c-b420-ee165d31ebc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:05.953711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5504-2df1-4a4c-b420-ee165d31ebc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:05.954088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a5504-2df1-4a4c-b420-ee165d31ebc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:05.972745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a5504-2df1-4a4c-b420-ee165d31ebc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:05.978101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a5504-2df1-4a4c-b420-ee165d31ebc9 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:06.000906 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 800/1599] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:05 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:06.108724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:06.110348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:06.152418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d1190-e2e6-4fab-8a33-93ef02d4e5c1 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:06.187264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:06.188513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:06.190889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:06.191344 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] PATH_INFO: `/v3/projects/8d690d5366234c8dbfbc35443567b4b6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:06.196171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d690d5366234c8dbfbc35443567b4b6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:06.198912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:06.328146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d690d5366234c8dbfbc35443567b4b6', 'request_id': 'req-4ca6a92f-c75c-48cd-9344-fbc181552b8a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:06.346041 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d690d5366234c8dbfbc35443567b4b6', 'request_id': 'req-4ca6a92f-c75c-48cd-9344-fbc181552b8a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:06.358173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d690d5366234c8dbfbc35443567b4b6', 'request_id': 'req-4ca6a92f-c75c-48cd-9344-fbc181552b8a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:06.381720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] The token cache is being invalidate because project 8d690d5366234c8dbfbc35443567b4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:06.382087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:06.385290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ca6a92f-c75c-48cd-9344-fbc181552b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:06.392573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 800/1600] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:06 2021] DELETE /identity/v3/projects/8d690d5366234c8dbfbc35443567b4b6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:06.395256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e23ab-5ffc-4d27-9db7-41a26032f041 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:06.395559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e23ab-5ffc-4d27-9db7-41a26032f041 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:06.395894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e23ab-5ffc-4d27-9db7-41a26032f041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:06.433966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-704e23ab-5ffc-4d27-9db7-41a26032f041 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:06.438274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-704e23ab-5ffc-4d27-9db7-41a26032f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:06.597720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 801/1601] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:06.609008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc013e2-4ad5-42c8-8b88-b35494344a78 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:06.609008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc013e2-4ad5-42c8-8b88-b35494344a78 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:06.609008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc013e2-4ad5-42c8-8b88-b35494344a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:06.659448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-dcc013e2-4ad5-42c8-8b88-b35494344a78 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:06.673165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-dcc013e2-4ad5-42c8-8b88-b35494344a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:06.694383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 801/1602] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:06.696315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e23ab-5ffc-4d27-9db7-41a26032f041 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:06.711946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e23ab-5ffc-4d27-9db7-41a26032f041 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:06.720787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:06.723524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:06.723893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:06.724799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:06.726446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:06.726841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:06.729097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:06.773550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 802/1603] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:06.778889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc013e2-4ad5-42c8-8b88-b35494344a78 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:06.791868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc013e2-4ad5-42c8-8b88-b35494344a78 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:06.824792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:06.825465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:06.825755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:06.826038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:06.826758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:06.828669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:06.887613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 802/1604] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:06 2021] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:06.889635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:06.914093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f39b-f641-49ab-8c16-330897e6dfab admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.093605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.094399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.095054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.095054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.095902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.098786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.151858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 803/1605] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:06 2021] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:07.156073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.168916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbbc1e-a145-4228-af3e-b457d799196a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.179855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.182808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.183239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.183563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.184408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.187738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.212560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 803/1606] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:07.214989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.231791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877d5f2-db59-4182-b6ea-a52707d03194 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.238807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.239520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.239817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.240117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.240893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.242628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.258919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 804/1607] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:07.261046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.265447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.268685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:07.276328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd860-6b09-4dfe-8b3c-d690fc626f39 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.281437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.282885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.282885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.283114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] PATH_INFO: `/v3/projects/6763f6d553f5477fb06c144467326bc4/users/6ebeed0119254b21aa93068a45ac7b40/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.288664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70019-815a-4dc9-83fa-6a8b9f16ff8b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.296939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.298420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.298949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.299522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] PATH_INFO: `/v3/projects/8f3ad851e3a040a79398b4b2d0f835e2` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.301232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6763f6d553f5477fb06c144467326bc4, user_id=6ebeed0119254b21aa93068a45ac7b40, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.303536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3ad851e3a040a79398b4b2d0f835e2)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.304522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.305676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: WARNING py.warnings [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 16:48:07.305676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: warnings.warn(msg) Oct 12 16:48:07.305676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: Oct 12 16:48:07.307882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.341519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 804/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:07 2021] PUT /identity/v3/projects/6763f6d553f5477fb06c144467326bc4/users/6ebeed0119254b21aa93068a45ac7b40/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:07.341519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.341519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:07.409182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3ad851e3a040a79398b4b2d0f835e2', 'request_id': 'req-4e53363a-4e9d-42ac-9044-fb20c053eb59'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:07.422846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3ad851e3a040a79398b4b2d0f835e2', 'request_id': 'req-4e53363a-4e9d-42ac-9044-fb20c053eb59'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:07.464600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f4e41-1654-482f-839d-d1e5a0808f70 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.509784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3ad851e3a040a79398b4b2d0f835e2', 'request_id': 'req-4e53363a-4e9d-42ac-9044-fb20c053eb59'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:07.528562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] The token cache is being invalidate because project 8f3ad851e3a040a79398b4b2d0f835e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:07.529148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:07.530013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4e53363a-4e9d-42ac-9044-fb20c053eb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:07.542321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 805/1609] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:07 2021] DELETE /identity/v3/projects/8f3ad851e3a040a79398b4b2d0f835e2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:07.546642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.547932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.548394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.576103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.577451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.578510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.579262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.581788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:07.597932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] MFA Rules not processed for user `6ebeed0119254b21aa93068a45ac7b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:07.599357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:07.600613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.603795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.636867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 805/1610] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:07 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:07.638615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.642140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:07.779351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 806/1611] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:07.784448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.786633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:07.809014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40992a82-874a-40cc-8d7c-5624edef00df service placement] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.822072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.823825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.828434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.828932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] PATH_INFO: `/v3/users/df526e68cd814acf8acc518b15d0109c` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.829065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c0562-7c01-46a9-b26d-9c0d72054e94 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:07.831887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df526e68cd814acf8acc518b15d0109c)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.840138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.854985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:07.855679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:07.855966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:07.856249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:07.856978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:07.858947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:07.932280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 807/1612] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:07 2021] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:07.936379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:07.987712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df526e68cd814acf8acc518b15d0109c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:07.995175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df526e68cd814acf8acc518b15d0109c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:08.014474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df526e68cd814acf8acc518b15d0109c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:08.067789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df526e68cd814acf8acc518b15d0109c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:08.073329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df526e68cd814acf8acc518b15d0109c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:08.139429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 806/1613] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:07 2021] DELETE /identity/v3/users/df526e68cd814acf8acc518b15d0109c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:08.154127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ac09-a9f3-4d4f-9030-808e1a5e3c5d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:08.287083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:08.288402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:08.288698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:08.288949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:08.290104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:08.295705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:08.331401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 808/1614] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:07 2021] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:08.335978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:08.337523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:08.373909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aacfd2-67a4-48eb-bd2c-daa90e4cf139 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:08.380736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:08.381998 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:08.382358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:08.382707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:08.383564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:08.386096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:08.401847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 807/1615] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:08 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:08.407945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:08.430216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0746347-bd14-4397-af1f-df727790972c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:08.446062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:08.446992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:08.454935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:08.455628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] PATH_INFO: `/v3/projects/d646c66309564ea5a14137402b1fe178/users/3d276f43ab3348c1bb0d3e147425c1ff/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:08.494242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d646c66309564ea5a14137402b1fe178, user_id=3d276f43ab3348c1bb0d3e147425c1ff, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:08.497921 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:08.541286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 809/1616] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:08 2021] PUT /identity/v3/projects/d646c66309564ea5a14137402b1fe178/users/3d276f43ab3348c1bb0d3e147425c1ff/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:08.544805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:08.558649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59bf1-f577-458f-81ab-d896d40a5f1d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:08.764005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb77225-7956-4bb6-987c-fbcdbcd807ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:08.767230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77225-7956-4bb6-987c-fbcdbcd807ba admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:08.767514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77225-7956-4bb6-987c-fbcdbcd807ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:08.767971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb77225-7956-4bb6-987c-fbcdbcd807ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:08.768960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb77225-7956-4bb6-987c-fbcdbcd807ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:08.770904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb77225-7956-4bb6-987c-fbcdbcd807ba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:08.801210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:08.807501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 808/1617] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:08 2021] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:08.814871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de9bce-2a9f-4725-aa6d-b1c623c01c35 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:08.827759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:08.831256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:08.831810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:08.833929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] PATH_INFO: `/v3/projects/d646c66309564ea5a14137402b1fe178/users/3d276f43ab3348c1bb0d3e147425c1ff/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:08.838781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d646c66309564ea5a14137402b1fe178, user_id=3d276f43ab3348c1bb0d3e147425c1ff, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:08.863579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:08.957795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 810/1618] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:08 2021] PUT /identity/v3/projects/d646c66309564ea5a14137402b1fe178/users/3d276f43ab3348c1bb0d3e147425c1ff/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:08.971593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:08.971986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:08.972272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:09.044456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] MFA Rules not processed for user `3d276f43ab3348c1bb0d3e147425c1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:09.047398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:09.155637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:09.157910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:09.254699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 809/1619] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:09.260236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:09.263430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:09.437723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3df8-e43b-47fa-8a9e-8e89b0fd4b80 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:09.456308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:09.457181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:09.460277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:09.460592 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] PATH_INFO: `/v3/projects/69289f03e5074f9d9c01f4d104f03004` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:09.466833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69289f03e5074f9d9c01f4d104f03004)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:09.480292 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:09.492915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab87ad-e6c6-4bfb-bd49-b98e965d66c2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:09.522569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55810891-c550-4014-bc1f-f3f08d95ad65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:09.522569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810891-c550-4014-bc1f-f3f08d95ad65 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:09.522569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810891-c550-4014-bc1f-f3f08d95ad65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:09.522569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810891-c550-4014-bc1f-f3f08d95ad65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:09.541772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55810891-c550-4014-bc1f-f3f08d95ad65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:09.543417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55810891-c550-4014-bc1f-f3f08d95ad65 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:09.586319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69289f03e5074f9d9c01f4d104f03004', 'request_id': 'req-fbe9713b-7f60-4004-8d3f-38aecd70dd55'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:09.587682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 810/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:09 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:09.608123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69289f03e5074f9d9c01f4d104f03004', 'request_id': 'req-fbe9713b-7f60-4004-8d3f-38aecd70dd55'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:09.616927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69289f03e5074f9d9c01f4d104f03004', 'request_id': 'req-fbe9713b-7f60-4004-8d3f-38aecd70dd55'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:09.647875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] The token cache is being invalidate because project 69289f03e5074f9d9c01f4d104f03004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:09.651147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:09.656710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fbe9713b-7f60-4004-8d3f-38aecd70dd55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:09.665136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 811/1621] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:09 2021] DELETE /identity/v3/projects/69289f03e5074f9d9c01f4d104f03004 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:09.667417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4aec-8943-45cd-a800-ba32ecb1c350 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:09.667969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4aec-8943-45cd-a800-ba32ecb1c350 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:09.668483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e4aec-8943-45cd-a800-ba32ecb1c350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:09.713809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-931e4aec-8943-45cd-a800-ba32ecb1c350 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:09.715445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-931e4aec-8943-45cd-a800-ba32ecb1c350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:09.858252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408929c6-a3ec-4e05-999f-1c9ec948c7a0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:09.859653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408929c6-a3ec-4e05-999f-1c9ec948c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:09.860100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408929c6-a3ec-4e05-999f-1c9ec948c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:09.863363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 811/1622] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:09.889322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-408929c6-a3ec-4e05-999f-1c9ec948c7a0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:09.890900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-408929c6-a3ec-4e05-999f-1c9ec948c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:09.905496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4aec-8943-45cd-a800-ba32ecb1c350 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:09.919566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e4aec-8943-45cd-a800-ba32ecb1c350 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:09.919912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 812/1623] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:09.933478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:09.934429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:09.934870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:09.935299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:09.936244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:09.936772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:09.938641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:09.976512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408929c6-a3ec-4e05-999f-1c9ec948c7a0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:09.977093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 812/1624] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:48:09.997928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408929c6-a3ec-4e05-999f-1c9ec948c7a0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:10.020471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:10.021157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.021507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.022331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.023052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:10.025009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:10.081237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 813/1625] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:09 2021] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:10.087876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:10.102062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7c57-2281-4000-9561-d684d171e70f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:10.208725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:10.210810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:10.254934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:10.256469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.258881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.259255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.260391 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:10.265403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:10.315460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 813/1626] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:10 2021] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:10.331471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:10.348467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f5890-33cf-48aa-962a-9e96e11ef77f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:10.350497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc012c8-0c23-4dbd-b257-ec6eb35342d6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:10.355984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:10.357526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.357999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.358491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.359423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:10.361095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:10.361891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:10.362213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.363796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.364498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] PATH_INFO: `/v3/users/6ebeed0119254b21aa93068a45ac7b40` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.367098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebeed0119254b21aa93068a45ac7b40)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:10.372232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:10.390264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 814/1627] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:10.391750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:10.403063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eb858-36c0-41cf-9aad-1b11a81b6682 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:10.408214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:10.409354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.409354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.409829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.410673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:10.413004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:10.426524 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 815/1628] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:10.432791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:10.460987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa221-29e5-4c56-bb4a-6a5de9625520 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:10.467812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cea9e-aea3-4fcd-aa01-7a4f68229801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:10.469046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cea9e-aea3-4fcd-aa01-7a4f68229801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.469641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cea9e-aea3-4fcd-aa01-7a4f68229801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.470108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cea9e-aea3-4fcd-aa01-7a4f68229801 admin admin] PATH_INFO: `/v3/projects/a443dd5ba139412582747280e086437d/users/17530d1669f14d77a94d6a3c0af68a3a/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.475492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebeed0119254b21aa93068a45ac7b40'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:10.494758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cea9e-aea3-4fcd-aa01-7a4f68229801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a443dd5ba139412582747280e086437d, user_id=17530d1669f14d77a94d6a3c0af68a3a, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:10.497046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebeed0119254b21aa93068a45ac7b40'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:10.514678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cea9e-aea3-4fcd-aa01-7a4f68229801 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:10.514937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebeed0119254b21aa93068a45ac7b40'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:10.515706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebeed0119254b21aa93068a45ac7b40'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:10.549163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-93589f77-0807-4777-b681-7dfafe5de741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebeed0119254b21aa93068a45ac7b40'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:10.554676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 816/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:10 2021] PUT /identity/v3/projects/a443dd5ba139412582747280e086437d/users/17530d1669f14d77a94d6a3c0af68a3a/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:10.561510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 814/1630] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:10 2021] DELETE /identity/v3/users/6ebeed0119254b21aa93068a45ac7b40 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:10.566077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.566365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.566583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.569156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.569502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.569780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.615496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:10.616954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:10.643027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] MFA Rules not processed for user `17530d1669f14d77a94d6a3c0af68a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:10.644513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:10.828919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 817/1631] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:10.885578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:10.887324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:10.888593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 815/1632] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:10.893520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:10.898627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:10.913148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0891c1-59c1-4995-bb77-e34289bdea98 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:10.934519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:10.936212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:10.938331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:10.941221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:10.944061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:10.947714 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:11.045537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 818/1633] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:10 2021] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:11.049910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:11.095678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2790573-9df5-46ae-b136-151a80ba948b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:11.226095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c043b0-e275-457a-a8ff-3fd5515636c6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:11.258541 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:11.260717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:11.263001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:11.265817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:11.266838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:11.274705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:11.292750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:11.294196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:11.294505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:11.294789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:11.327250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:11.333108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:11.335897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 819/1634] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:11 2021] POST /identity/v3/users => generated 300 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:11.339864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:11.368328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f6f17-a43a-44a3-9d54-90a9fb8061ef admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:11.372922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 816/1635] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:11.386205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:11.386901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:11.387190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:11.387472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:11.388289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:11.389930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:11.442908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 820/1636] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:11.444281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:11.454314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fc6f5-9532-4ccb-9096-96c6ba6a74ff service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:11.469442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:11.470502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:11.470796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:11.471076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] PATH_INFO: `/v3/projects/74aa85dee5cd44238e73d53157ec84ec/users/f6295d7c4d3f4f2387fbfd5fb95e1023/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:11.502323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74aa85dee5cd44238e73d53157ec84ec, user_id=f6295d7c4d3f4f2387fbfd5fb95e1023, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:11.505039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:11.536176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 817/1637] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:11 2021] PUT /identity/v3/projects/74aa85dee5cd44238e73d53157ec84ec/users/f6295d7c4d3f4f2387fbfd5fb95e1023/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:11.537521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:11.551871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac673f1-eff1-4fca-9aae-c70e135663a6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:11.687390 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdeec4-2f00-4bc8-a437-d754ebe029c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:11.688317 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdeec4-2f00-4bc8-a437-d754ebe029c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:11.688615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdeec4-2f00-4bc8-a437-d754ebe029c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:11.688902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdeec4-2f00-4bc8-a437-d754ebe029c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:11.690180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdeec4-2f00-4bc8-a437-d754ebe029c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:11.695492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdeec4-2f00-4bc8-a437-d754ebe029c0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:11.722725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:11.723388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 821/1638] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:11 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:11.733789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a3906b-4eb3-455f-bdb0-2fb783b98602 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:11.748434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:11.752848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:11.753230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:11.753590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] PATH_INFO: `/v3/projects/74aa85dee5cd44238e73d53157ec84ec/users/f6295d7c4d3f4f2387fbfd5fb95e1023/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:11.766632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74aa85dee5cd44238e73d53157ec84ec, user_id=f6295d7c4d3f4f2387fbfd5fb95e1023, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:11.769313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:11.791662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 818/1639] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:11 2021] PUT /identity/v3/projects/74aa85dee5cd44238e73d53157ec84ec/users/f6295d7c4d3f4f2387fbfd5fb95e1023/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:11.849970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d93c1-22f1-436b-a008-4a75cec03405 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:11.850628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d93c1-22f1-436b-a008-4a75cec03405 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:11.851109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d93c1-22f1-436b-a008-4a75cec03405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:11.906255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-043d93c1-22f1-436b-a008-4a75cec03405 None None] MFA Rules not processed for user `f6295d7c4d3f4f2387fbfd5fb95e1023`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:11.908945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-043d93c1-22f1-436b-a008-4a75cec03405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:12.021270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 822/1640] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:11 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:12.028404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:12.030757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:12.188057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c512b0-ba9f-4365-893f-5cf5a7b8a380 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:12.204228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:12.205268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:12.206230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:12.206230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:12.236911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:12.239363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:12.266321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 819/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:12 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:12.319358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d93c1-22f1-436b-a008-4a75cec03405 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:12.432799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d93c1-22f1-436b-a008-4a75cec03405 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:12.446638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:12.447616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:12.448160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:12.448446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] PATH_INFO: `/v3/users/17530d1669f14d77a94d6a3c0af68a3a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:12.449731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17530d1669f14d77a94d6a3c0af68a3a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:12.454071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:12.572763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17530d1669f14d77a94d6a3c0af68a3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.573821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17530d1669f14d77a94d6a3c0af68a3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.588268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17530d1669f14d77a94d6a3c0af68a3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.607874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17530d1669f14d77a94d6a3c0af68a3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.608700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54543469-7021-462c-bfc0-3795b2b40696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17530d1669f14d77a94d6a3c0af68a3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.659316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:12.660930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:12.668362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 823/1642] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:12 2021] DELETE /identity/v3/users/17530d1669f14d77a94d6a3c0af68a3a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:12.673937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:12.674120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:12.675944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:12.684842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba154b-044a-4be9-94b3-d1856bc00283 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:12.720665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:12.725221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:12.824961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:12.826091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:12.826752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:12.827314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] PATH_INFO: `/v3/projects/6763f6d553f5477fb06c144467326bc4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:12.829659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6763f6d553f5477fb06c144467326bc4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:12.832497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:12.913700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 824/1643] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:12.925480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6763f6d553f5477fb06c144467326bc4', 'request_id': 'req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.945052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6763f6d553f5477fb06c144467326bc4', 'request_id': 'req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.964466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6763f6d553f5477fb06c144467326bc4', 'request_id': 'req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:12.972075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:12.976910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:12.998616 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] The token cache is being invalidate because project 6763f6d553f5477fb06c144467326bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:12.998986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:13.003479 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:13.005607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 820/1644] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:12 2021] DELETE /identity/v3/projects/6763f6d553f5477fb06c144467326bc4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:13.009925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:13.015148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:13.169881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76197-ee2e-4efc-bd66-60fb6819d7d2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:13.217036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bb539-6540-4da8-bd5e-fb1d98ae1df9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:13.233156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:13.234918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:13.236134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:13.236458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] PATH_INFO: `/v3/users/3d276f43ab3348c1bb0d3e147425c1ff` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:13.238578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d276f43ab3348c1bb0d3e147425c1ff)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:13.250249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:13.332979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8594b-ee98-417f-8996-22600ba9446d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:13.333999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8594b-ee98-417f-8996-22600ba9446d service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:13.334462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8594b-ee98-417f-8996-22600ba9446d service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:13.334891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8594b-ee98-417f-8996-22600ba9446d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:13.341080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6ca8594b-ee98-417f-8996-22600ba9446d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:13.365796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d276f43ab3348c1bb0d3e147425c1ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:13.381437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8594b-ee98-417f-8996-22600ba9446d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:13.382956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8594b-ee98-417f-8996-22600ba9446d service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:13.391125 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d276f43ab3348c1bb0d3e147425c1ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:13.405799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 825/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:13.421202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d276f43ab3348c1bb0d3e147425c1ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:13.425809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d276f43ab3348c1bb0d3e147425c1ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:13.467202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d276f43ab3348c1bb0d3e147425c1ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:13.485864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 821/1646] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:13 2021] DELETE /identity/v3/users/3d276f43ab3348c1bb0d3e147425c1ff => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:13.582825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:13.583216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:13.583688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:13.642916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] MFA Rules not processed for user `80558ff481cc4871b5f3f361c42edd17`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:13.645178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:13.794488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 826/1647] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:13 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:13.806235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:13.807683 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:13.989229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc0516-6a9b-4dca-824f-e38903a2b375 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:13.997359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:13.998318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:13.998738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:13.999129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.013604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:14.017362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:14.052398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 822/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:13 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:14.236618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:14.238206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:14.398264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:14.399686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:14.426573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd656e-f4a4-4057-9190-cb7eecdc9844 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:14.428635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb1493-41a1-4b71-ad72-e74e1d7659a6 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:14.442583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:14.443654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.443941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.444154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:14.444459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] PATH_INFO: `/v3/projects/d646c66309564ea5a14137402b1fe178` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.445960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d646c66309564ea5a14137402b1fe178)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:14.447198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.447647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.448128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] PATH_INFO: `/v3/projects/a443dd5ba139412582747280e086437d` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.448259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:14.450526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a443dd5ba139412582747280e086437d)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:14.452827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:14.571959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd646c66309564ea5a14137402b1fe178', 'request_id': 'req-c58c9a93-4f61-4d9d-95d2-bb12363c5270'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.587848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a443dd5ba139412582747280e086437d', 'request_id': 'req-799248f1-d387-47d5-8739-94bab0f40856'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.601291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd646c66309564ea5a14137402b1fe178', 'request_id': 'req-c58c9a93-4f61-4d9d-95d2-bb12363c5270'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.614031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a443dd5ba139412582747280e086437d', 'request_id': 'req-799248f1-d387-47d5-8739-94bab0f40856'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.616359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd646c66309564ea5a14137402b1fe178', 'request_id': 'req-c58c9a93-4f61-4d9d-95d2-bb12363c5270'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.631741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a443dd5ba139412582747280e086437d', 'request_id': 'req-799248f1-d387-47d5-8739-94bab0f40856'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.639610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] The token cache is being invalidate because project d646c66309564ea5a14137402b1fe178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:14.640190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.642417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c58c9a93-4f61-4d9d-95d2-bb12363c5270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.646445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 823/1649] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:14 2021] DELETE /identity/v3/projects/d646c66309564ea5a14137402b1fe178 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:14.653849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97b5c-544e-4dba-9bff-8296caf26a70 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.654171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97b5c-544e-4dba-9bff-8296caf26a70 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.654466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e97b5c-544e-4dba-9bff-8296caf26a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.676312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] The token cache is being invalidate because project a443dd5ba139412582747280e086437d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:14.676629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.678277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.689238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 827/1650] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:14 2021] DELETE /identity/v3/projects/a443dd5ba139412582747280e086437d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:14.694174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:14.697974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:14.700804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-19e97b5c-544e-4dba-9bff-8296caf26a70 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:14.703324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-19e97b5c-544e-4dba-9bff-8296caf26a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:14.826900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799248f1-d387-47d5-8739-94bab0f40856 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:14.853068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:14.854222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.854699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.855866 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] PATH_INFO: `/v3/users/f6295d7c4d3f4f2387fbfd5fb95e1023` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.857572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6295d7c4d3f4f2387fbfd5fb95e1023)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:14.860249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:14.944738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 824/1651] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:14.956376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5f87-91c3-4c32-97a5-7cb6206c6d11 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:14.956762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5f87-91c3-4c32-97a5-7cb6206c6d11 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:14.957980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6295d7c4d3f4f2387fbfd5fb95e1023'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.960160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6295d7c4d3f4f2387fbfd5fb95e1023'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:14.964315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d5f87-91c3-4c32-97a5-7cb6206c6d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:14.983255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6295d7c4d3f4f2387fbfd5fb95e1023'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:15.011517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6295d7c4d3f4f2387fbfd5fb95e1023'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:15.015427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4864746-84df-425d-8749-8c3197127a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6295d7c4d3f4f2387fbfd5fb95e1023'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:15.038427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a27d5f87-91c3-4c32-97a5-7cb6206c6d11 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:15.039756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a27d5f87-91c3-4c32-97a5-7cb6206c6d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:15.073397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 825/1652] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:15.078273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d5f87-91c3-4c32-97a5-7cb6206c6d11 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:15.095094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 828/1653] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:14 2021] DELETE /identity/v3/users/f6295d7c4d3f4f2387fbfd5fb95e1023 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:15.102919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d5f87-91c3-4c32-97a5-7cb6206c6d11 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:15.313338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:15.314120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:15.315258 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:15.319081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:15.319777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:15.320062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:15.320525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:15.321481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:15.322484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:15.324664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:15.352793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 826/1654] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:15.358059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:15.442123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03da139-39b4-4dda-b7e2-8ad1d232994f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:15.442989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] MFA Rules not processed for user `6363ee6ea7c441ccbd9d8dc5ab30cebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:15.442989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:15.443773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:15.443773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:15.443773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:15.443773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:15.444187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:15.444187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:15.575453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 827/1655] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:15 2021] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:15.582415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:15.696544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 829/1656] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:15 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:15.710197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:15.718529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:15.727100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0caac8-f01b-456b-8dfd-8c7d729656b2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:15.735156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af154a1-8247-4ca0-90f6-008ea9a409c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:15.740156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af154a1-8247-4ca0-90f6-008ea9a409c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:15.740711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af154a1-8247-4ca0-90f6-008ea9a409c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:15.741172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af154a1-8247-4ca0-90f6-008ea9a409c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:15.742267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af154a1-8247-4ca0-90f6-008ea9a409c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:15.744400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af154a1-8247-4ca0-90f6-008ea9a409c9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:15.791302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 828/1657] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:15 2021] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:15.791888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a89bd-43fb-4eb6-9b13-727bec5d5b43 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:15.792608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a89bd-43fb-4eb6-9b13-727bec5d5b43 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:15.793036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a89bd-43fb-4eb6-9b13-727bec5d5b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:15.823124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b52a89bd-43fb-4eb6-9b13-727bec5d5b43 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:15.825032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b52a89bd-43fb-4eb6-9b13-727bec5d5b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:15.899623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9bee-c336-442a-9a27-8368b4a5e5e4 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:16.028276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:16.030519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.030978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.031267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.056383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 829/1658] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:48:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:16.062975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a89bd-43fb-4eb6-9b13-727bec5d5b43 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:16.100319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a89bd-43fb-4eb6-9b13-727bec5d5b43 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:16.112151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:16.112856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.113148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.113458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.114227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:16.117697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:16.153580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 830/1659] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:16 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:16.154782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:16.159961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:16.181240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:16.183075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:16.189143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adba6d-ca17-4474-9b68-89cce37d2cb5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:16.200723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 830/1660] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:15 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:16.201622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:16.202778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.203223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.211739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] PATH_INFO: `/v3/projects/74aa85dee5cd44238e73d53157ec84ec` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.213436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:16.214321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74aa85dee5cd44238e73d53157ec84ec)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:16.216651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:16.238529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bfe2d-08b2-4556-8a67-91c98e06a2a3 service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:16.247140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:16.248323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.248762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.249190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.250145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:16.252804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:16.276015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 831/1661] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:16 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:16.277199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:16.287884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547a238-622b-41e0-a93b-7ad44e3891e6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:16.303524 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672b53b-6230-474e-a15d-f10c04f22ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:16.304719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672b53b-6230-474e-a15d-f10c04f22ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.305171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672b53b-6230-474e-a15d-f10c04f22ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.305639 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672b53b-6230-474e-a15d-f10c04f22ea1 admin admin] PATH_INFO: `/v3/projects/8e27fc0b9a834580bcb84c2bd290450c/users/5b9728ea0e874b338d9d944a58f9d64f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.335608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74aa85dee5cd44238e73d53157ec84ec', 'request_id': 'req-9af50d36-6dfb-49f2-9492-69af46fbc5c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:16.339243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672b53b-6230-474e-a15d-f10c04f22ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e27fc0b9a834580bcb84c2bd290450c, user_id=5b9728ea0e874b338d9d944a58f9d64f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:16.345148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672b53b-6230-474e-a15d-f10c04f22ea1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:16.367890 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74aa85dee5cd44238e73d53157ec84ec', 'request_id': 'req-9af50d36-6dfb-49f2-9492-69af46fbc5c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:16.373651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 832/1662] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:16 2021] PUT /identity/v3/projects/8e27fc0b9a834580bcb84c2bd290450c/users/5b9728ea0e874b338d9d944a58f9d64f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:16.384449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74aa85dee5cd44238e73d53157ec84ec', 'request_id': 'req-9af50d36-6dfb-49f2-9492-69af46fbc5c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:16.387597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff27e-3334-4c87-9f54-44880044f261 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.389047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff27e-3334-4c87-9f54-44880044f261 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.389355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff27e-3334-4c87-9f54-44880044f261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.454094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b0cff27e-3334-4c87-9f54-44880044f261 None None] MFA Rules not processed for user `5b9728ea0e874b338d9d944a58f9d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:16.455353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b0cff27e-3334-4c87-9f54-44880044f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:16.455844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] The token cache is being invalidate because project 74aa85dee5cd44238e73d53157ec84ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:16.456376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:16.456813 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:16.466524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 831/1663] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:16 2021] DELETE /identity/v3/projects/74aa85dee5cd44238e73d53157ec84ec => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:16.467447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:16.475453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:16.671385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 833/1664] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:16 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:16.676444 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.676940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.678441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.708910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af50d36-6dfb-49f2-9492-69af46fbc5c2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:16.767702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:16.770682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:16.839239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:16.841312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:16.844050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:16.844497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:16.852109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:16.956387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:16.958360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:16.980956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 832/1665] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:48:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:48:16.984840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:16.987666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:17.054636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 834/1666] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:17.055840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:17.064932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:17.156294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72505b99-4e6d-4b54-98c9-cb83555aea6d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:17.197812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca0f69-57a8-4116-a988-fa5e54d3d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:17.204092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca0f69-57a8-4116-a988-fa5e54d3d169 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:17.206369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca0f69-57a8-4116-a988-fa5e54d3d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:17.210867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca0f69-57a8-4116-a988-fa5e54d3d169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:17.217857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca0f69-57a8-4116-a988-fa5e54d3d169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:17.230241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca0f69-57a8-4116-a988-fa5e54d3d169 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:17.270143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd8d04-6c0c-48da-b23e-d134a075860e service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:17.284231 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:17.285325 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:17.285805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:17.286432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] PATH_INFO: `/v3/users/494090a6abb8483eb0f5bf354c219ad6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:17.289986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=494090a6abb8483eb0f5bf354c219ad6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:17.295853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:17.323384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 835/1667] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:17 2021] POST /identity/v3/projects => generated 365 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:17.323384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfe6d9-8dc6-4aec-bdbb-d6725b70160b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:17.323384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfe6d9-8dc6-4aec-bdbb-d6725b70160b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:17.323730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfe6d9-8dc6-4aec-bdbb-d6725b70160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:17.385824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c5bfe6d9-8dc6-4aec-bdbb-d6725b70160b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:17.397645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c5bfe6d9-8dc6-4aec-bdbb-d6725b70160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:17.424006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494090a6abb8483eb0f5bf354c219ad6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:17.466140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494090a6abb8483eb0f5bf354c219ad6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:17.487472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494090a6abb8483eb0f5bf354c219ad6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:17.488517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494090a6abb8483eb0f5bf354c219ad6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:17.519813 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494090a6abb8483eb0f5bf354c219ad6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:17.556800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 833/1668] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:16 2021] DELETE /identity/v3/users/494090a6abb8483eb0f5bf354c219ad6 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:17.558193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:17.564573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:17.611850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 836/1669] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:17.616149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0cdeb-e132-4722-9560-603e0f9cdbc9 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:17.616456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0cdeb-e132-4722-9560-603e0f9cdbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:17.616876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0cdeb-e132-4722-9560-603e0f9cdbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:17.660772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ecc0cdeb-e132-4722-9560-603e0f9cdbc9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:17.673037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ecc0cdeb-e132-4722-9560-603e0f9cdbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:17.816118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d4ed5-f16d-4fb2-b50d-f646442aab66 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:17.833569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:17.834967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:17.835307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:17.835571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:17.837833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:17.845816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:17.853128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 837/1670] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:17.855528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0cdeb-e132-4722-9560-603e0f9cdbc9 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:17.888744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0cdeb-e132-4722-9560-603e0f9cdbc9 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:17.904224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:17.905690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:17.906601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:17.907668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:17.913700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:17.915106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:17.925350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 834/1671] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:17 2021] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:17.927469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:17.928666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:17.951818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562c765-fa04-4ed5-9876-fc4c0af5394a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:17.977413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 838/1672] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:17.978222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:17.979085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:17.979540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:17.980370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:17.980818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:17.981954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:17.986028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.001438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45acc-2932-4091-a898-b826492e2a8d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.010310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:18.011141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.011587 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.011970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.013940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:18.016187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.030275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 835/1673] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:17 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:18.031493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:18.058980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223a27-8514-4748-8927-dfa37c9f7426 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.076886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 839/1674] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:17 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:18.078398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:18.080675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:18.081702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:18.083179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.087748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.088307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] PATH_INFO: `/v3/projects/46b780e687e04476a9390cd2fbcffb5b/users/b8c75f986f19409c9c25be2d43cb5824/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.138872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b780e687e04476a9390cd2fbcffb5b, user_id=b8c75f986f19409c9c25be2d43cb5824, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:18.141922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.178176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 836/1675] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:18 2021] PUT /identity/v3/projects/46b780e687e04476a9390cd2fbcffb5b/users/b8c75f986f19409c9c25be2d43cb5824/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:18.195870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:18.423429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5456ca-a8a2-45b6-be23-0b22022e5875 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.474575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0b7b2-e084-48c1-813d-b07c8786fbb5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.500298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:18.501124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.501458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.502076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.502968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:18.508144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.587436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 837/1676] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:18 2021] POST /identity/v3/users => generated 291 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:18.588363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:18.594937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:18.599279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:18.604156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.604472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.607750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.642271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c26d2-b76d-4a69-b3df-b6f34a4612f1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.645604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:18.651093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.654800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:18.655712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.656001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.656284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] PATH_INFO: `/v3/users/0a39650a52c4417bbe08ac06dc4219dd` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.663858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a39650a52c4417bbe08ac06dc4219dd)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:18.666682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.686953 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 840/1677] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:18.687485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:18.726706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459e72c-7964-4fa7-a3c9-2bf2bd287760 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.751014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:18.754539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.754829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.755113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.755895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:18.757543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.771726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a39650a52c4417bbe08ac06dc4219dd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:18.792461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a39650a52c4417bbe08ac06dc4219dd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:18.795393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 841/1678] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:18 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:18.795775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:18.809474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a39650a52c4417bbe08ac06dc4219dd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:18.821425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a39650a52c4417bbe08ac06dc4219dd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:18.839933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e211a0-667b-439f-92dc-cc4c5aae3461 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.841426 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-40ee45c8-cd63-4863-837b-b9d53c25a676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a39650a52c4417bbe08ac06dc4219dd'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:18.852483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 838/1679] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:18 2021] DELETE /identity/v3/users/0a39650a52c4417bbe08ac06dc4219dd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:18.854094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70c1da-2c12-4913-bfec-56a8e11309d2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.854389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70c1da-2c12-4913-bfec-56a8e11309d2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.855147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70c1da-2c12-4913-bfec-56a8e11309d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.866340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:18.866917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.867208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.867492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:18.869259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:18.870612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:18.884472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-cd70c1da-2c12-4913-bfec-56a8e11309d2 None None] MFA Rules not processed for user `671f4f6ff7d84739aecf74e53bb1aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:18.886029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cd70c1da-2c12-4913-bfec-56a8e11309d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:18.900957 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 842/1680] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:18 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:18.904599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:18.908701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:18.956329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751369f9-1e3a-4311-b048-c38f429dbd7d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:18.969556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 839/1681] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 12 16:48:18 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:18.971538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:18.972098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:18.972690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.003057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:19.009314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:19.121787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:19.122780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.123069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.123349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] PATH_INFO: `/v3/projects/46b780e687e04476a9390cd2fbcffb5b/users/b8c75f986f19409c9c25be2d43cb5824/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.132030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b780e687e04476a9390cd2fbcffb5b, user_id=b8c75f986f19409c9c25be2d43cb5824, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:19.132780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 840/1682] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:19.133867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:19.139432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:19.155029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:19.155890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 843/1683] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:18 2021] PUT /identity/v3/projects/46b780e687e04476a9390cd2fbcffb5b/users/b8c75f986f19409c9c25be2d43cb5824/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:19.157216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:19.164449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:19.178383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeaff3-53d8-4b22-a4e7-3e570ec8e7c5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:19.308373 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:19.308595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2308d22-55a2-438d-bc86-40d6ddb95ca8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:19.311238 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.312462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.312977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.314864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:19.317588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:19.333416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934de88-84b0-4cfc-b62e-7d3428fe8f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:19.335232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934de88-84b0-4cfc-b62e-7d3428fe8f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.337141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 841/1684] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:19.341693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934de88-84b0-4cfc-b62e-7d3428fe8f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.341693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934de88-84b0-4cfc-b62e-7d3428fe8f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.346387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:19.388011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934de88-84b0-4cfc-b62e-7d3428fe8f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:19.390051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934de88-84b0-4cfc-b62e-7d3428fe8f05 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:19.393359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de21b9-56a3-458a-aaef-3bb5c7518d84 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:19.398950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:19.399662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.400008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.400704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.402503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 844/1685] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:19 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:19.404775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.405230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.405744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.433172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:19.435162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:19.450180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 842/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:19.451289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:19.464079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44b49-dbd5-4264-b93f-ab2dc184650e service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:19.472337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3dccf-1771-4f93-8ec3-ecc7e1bdf7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:19.473290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3dccf-1771-4f93-8ec3-ecc7e1bdf7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.473816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3dccf-1771-4f93-8ec3-ecc7e1bdf7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.475018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3dccf-1771-4f93-8ec3-ecc7e1bdf7a7 admin admin] PATH_INFO: `/v3/projects/ae69c3303cf84015a9c4718f962b8a84/users/6dae21ee39ed4d1bbccb30c464940808/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.488861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] MFA Rules not processed for user `b8c75f986f19409c9c25be2d43cb5824`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:19.490709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:19.519909 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3dccf-1771-4f93-8ec3-ecc7e1bdf7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae69c3303cf84015a9c4718f962b8a84, user_id=6dae21ee39ed4d1bbccb30c464940808, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:19.554537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3dccf-1771-4f93-8ec3-ecc7e1bdf7a7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:19.591181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 843/1687] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:19 2021] PUT /identity/v3/projects/ae69c3303cf84015a9c4718f962b8a84/users/6dae21ee39ed4d1bbccb30c464940808/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:19.597614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:19.597914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:19.598201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:19.724986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] MFA Rules not processed for user `6dae21ee39ed4d1bbccb30c464940808`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:19.729320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:19.771457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 845/1688] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:19 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:19.784256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:19.790348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:19.910624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 844/1689] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:19 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:19.910624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:19.914022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:20.017013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65ef8-13ab-4928-81b0-fcfb18fdcf95 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:20.070696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689458b9-ea07-495f-bc33-6a3d922bbcb5 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:20.085610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:20.086666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:20.087050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:20.087562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] PATH_INFO: `/v3/users/b4699fa07892493c958be897f133f9e0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:20.089711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4699fa07892493c958be897f133f9e0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:20.096001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:20.214195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db77bb-3683-4293-8a97-7238d0284467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:20.214935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db77bb-3683-4293-8a97-7238d0284467 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:20.215174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db77bb-3683-4293-8a97-7238d0284467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:20.215461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db77bb-3683-4293-8a97-7238d0284467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:20.237779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4699fa07892493c958be897f133f9e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:20.264012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4699fa07892493c958be897f133f9e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:20.275690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4699fa07892493c958be897f133f9e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:20.276845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4699fa07892493c958be897f133f9e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:20.312387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4699fa07892493c958be897f133f9e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:20.362007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 845/1690] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:19 2021] DELETE /identity/v3/users/b4699fa07892493c958be897f133f9e0 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:20.365035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:20.371056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:20.409637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db77bb-3683-4293-8a97-7238d0284467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:20.411397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db77bb-3683-4293-8a97-7238d0284467 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:20.439410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 846/1691] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:19 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:20.442926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1454-9b22-4664-be78-32f7e6ef4c26 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:20.446912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1454-9b22-4664-be78-32f7e6ef4c26 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:20.447343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1454-9b22-4664-be78-32f7e6ef4c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:20.484895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7a9a2-da85-4a3e-828b-34473174c7cd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:20.490822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:20.491500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:20.491828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:20.492114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:20.493256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:20.495986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:20.496677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-adcc1454-9b22-4664-be78-32f7e6ef4c26 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:20.499982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-adcc1454-9b22-4664-be78-32f7e6ef4c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:20.531225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 847/1692] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:20.559300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 846/1693] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:20 2021] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:20.562524 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1454-9b22-4664-be78-32f7e6ef4c26 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:20.573131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1454-9b22-4664-be78-32f7e6ef4c26 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:20.605774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:20.612648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:20.741493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:20.742209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:20.742497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:20.742781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:20.743512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:20.756783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:20.825764 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628eb96b-07d2-4a27-9517-b53dfd4aea08 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:20.838401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 848/1694] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:20 2021] POST /identity/v3/users => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:20.841115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:20.841736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:20.842026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:20.842322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:20.844583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:20.868243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0096d5e-a6ca-42c8-b268-f29589c845cc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:20.876888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:20.880021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:20.887181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:20.887874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:20.888162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:20.888441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:20.889208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:20.890920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:20.911362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 847/1695] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:20.921195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 849/1696] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:20 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:20.929083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:20.950948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f7e91-af36-4ca5-9622-f6409893997d service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:20.992205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:21.000944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.004480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.007318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] PATH_INFO: `/v3/projects/e507c5a4b9d04649a2f0547331444de9/users/7e2cbf4d2b824dd29290e4802295d2ee/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.065210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e507c5a4b9d04649a2f0547331444de9, user_id=7e2cbf4d2b824dd29290e4802295d2ee, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:21.069275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:21.098403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 848/1697] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:20 2021] PUT /identity/v3/projects/e507c5a4b9d04649a2f0547331444de9/users/7e2cbf4d2b824dd29290e4802295d2ee/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:21.104957 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:21.120945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3770955-690c-46a5-95e4-491449c3ee04 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:21.154444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:21.156587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:21.261963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:21.262765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.263103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.263457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.278960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:21.281355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:21.304505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 850/1698] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:21 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:21.306024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:21.307806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:21.316421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72735491-98f7-4c2d-b144-7ebd7660f3c4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:21.342914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:21.343980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.344341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.344700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] PATH_INFO: `/v3/users/5b9728ea0e874b338d9d944a58f9d64f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.346216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9728ea0e874b338d9d944a58f9d64f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:21.348945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:21.355746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50f16a-2fd7-4055-a3d5-01b3f8d2d735 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:21.368469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:21.372866 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.373308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.373619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] PATH_INFO: `/v3/projects/bcc9dc092411436db420dbd261c512fb` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.375181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc9dc092411436db420dbd261c512fb)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:21.399063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:21.470958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9728ea0e874b338d9d944a58f9d64f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.486756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9728ea0e874b338d9d944a58f9d64f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.501164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9728ea0e874b338d9d944a58f9d64f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.503794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc9dc092411436db420dbd261c512fb', 'request_id': 'req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.504837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9728ea0e874b338d9d944a58f9d64f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.535370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc9dc092411436db420dbd261c512fb', 'request_id': 'req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.544859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc9dc092411436db420dbd261c512fb', 'request_id': 'req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.555694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-156023ad-5ade-4299-9f78-f874d5d78164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9728ea0e874b338d9d944a58f9d64f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.561895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] The token cache is being invalidate because project bcc9dc092411436db420dbd261c512fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:21.562119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.562970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:21.565261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 851/1699] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:21 2021] DELETE /identity/v3/projects/bcc9dc092411436db420dbd261c512fb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:21.566729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 849/1700] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:21 2021] DELETE /identity/v3/users/5b9728ea0e874b338d9d944a58f9d64f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:21.575459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3f0db-3def-48e6-9745-2064b6cc303b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.575984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3f0db-3def-48e6-9745-2064b6cc303b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.576630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3f0db-3def-48e6-9745-2064b6cc303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.594016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:21.598767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:21.616935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-34c3f0db-3def-48e6-9745-2064b6cc303b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:21.620699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-34c3f0db-3def-48e6-9745-2064b6cc303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:21.798283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 850/1701] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:21.804214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.804546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.804789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.827054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:21.828575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:21.862344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 851/1702] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:21.862344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:21.862344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:21.866736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2e13-0cf7-46ae-aa44-9e22b081ab2f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:21.890570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:21.896125 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135824d-c671-4ade-b6f1-8797420879b9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:21.897900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.899785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.900686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] PATH_INFO: `/v3/projects/e507c5a4b9d04649a2f0547331444de9/users/7e2cbf4d2b824dd29290e4802295d2ee/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.910010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:21.910897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:21.911187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:21.911590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] PATH_INFO: `/v3/projects/86d9dfd66b6646c5b8245f4954896b15` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:21.912519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e507c5a4b9d04649a2f0547331444de9, user_id=7e2cbf4d2b824dd29290e4802295d2ee, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:21.916557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d9dfd66b6646c5b8245f4954896b15)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:21.918469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:21.920820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:21.952398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 852/1703] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:21 2021] PUT /identity/v3/projects/e507c5a4b9d04649a2f0547331444de9/users/7e2cbf4d2b824dd29290e4802295d2ee/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:21.962281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:21.971427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.080832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d9dfd66b6646c5b8245f4954896b15', 'request_id': 'req-51a8cd00-949e-471c-a9a9-b20b00be6111'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:22.102193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d9dfd66b6646c5b8245f4954896b15', 'request_id': 'req-51a8cd00-949e-471c-a9a9-b20b00be6111'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:22.112720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d9dfd66b6646c5b8245f4954896b15', 'request_id': 'req-51a8cd00-949e-471c-a9a9-b20b00be6111'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:22.159720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] The token cache is being invalidate because project 86d9dfd66b6646c5b8245f4954896b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:22.160274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:22.163794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-51a8cd00-949e-471c-a9a9-b20b00be6111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:22.172271 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d5807-b3b0-4921-ac9f-8a24c35e6363 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:22.178720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 852/1704] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:21 2021] DELETE /identity/v3/projects/86d9dfd66b6646c5b8245f4954896b15 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:22.188688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf329-4a48-4040-8fe8-4517fc90fba4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.189401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf329-4a48-4040-8fe8-4517fc90fba4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.190151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bf329-4a48-4040-8fe8-4517fc90fba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.250718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-804bf329-4a48-4040-8fe8-4517fc90fba4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:22.252258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-804bf329-4a48-4040-8fe8-4517fc90fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.321668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58862ebc-a16c-42ae-89df-2ac2ef472ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:22.322570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58862ebc-a16c-42ae-89df-2ac2ef472ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.322934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58862ebc-a16c-42ae-89df-2ac2ef472ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.323289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58862ebc-a16c-42ae-89df-2ac2ef472ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.329364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-58862ebc-a16c-42ae-89df-2ac2ef472ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.419436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 853/1705] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:22.421641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162954be-ce6a-44d8-87a9-7ce447d3fa2a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.421641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162954be-ce6a-44d8-87a9-7ce447d3fa2a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.421811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162954be-ce6a-44d8-87a9-7ce447d3fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.518849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-162954be-ce6a-44d8-87a9-7ce447d3fa2a None None] MFA Rules not processed for user `7e2cbf4d2b824dd29290e4802295d2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:22.529105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-162954be-ce6a-44d8-87a9-7ce447d3fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.533160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58862ebc-a16c-42ae-89df-2ac2ef472ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:22.539778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58862ebc-a16c-42ae-89df-2ac2ef472ea8 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:22.587000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 853/1706] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:22.590490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d325-c20c-42aa-897e-4bd474a3839f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.590701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d325-c20c-42aa-897e-4bd474a3839f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.593814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294d325-c20c-42aa-897e-4bd474a3839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.653410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c294d325-c20c-42aa-897e-4bd474a3839f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:22.657267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c294d325-c20c-42aa-897e-4bd474a3839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.679778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 854/1707] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:22.682964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d325-c20c-42aa-897e-4bd474a3839f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:22.689795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 854/1708] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:22 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:22.691328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0e82-432b-43a0-9788-6ef89025b60d None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.694977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0e82-432b-43a0-9788-6ef89025b60d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.695389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0e82-432b-43a0-9788-6ef89025b60d None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.698130 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 855/1709] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:48:22 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:22.703911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee960-f0e6-4549-9d69-435959909575 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.705704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee960-f0e6-4549-9d69-435959909575 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.706104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eee960-f0e6-4549-9d69-435959909575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.710240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294d325-c20c-42aa-897e-4bd474a3839f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:22.723765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ef166-883d-45a3-9b5b-5c1c70c3464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:22.727090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ef166-883d-45a3-9b5b-5c1c70c3464b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.727392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ef166-883d-45a3-9b5b-5c1c70c3464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.727675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ef166-883d-45a3-9b5b-5c1c70c3464b admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.728447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ef166-883d-45a3-9b5b-5c1c70c3464b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:22.728757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ef166-883d-45a3-9b5b-5c1c70c3464b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:22.734426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ef166-883d-45a3-9b5b-5c1c70c3464b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:22.749005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-16eee960-f0e6-4549-9d69-435959909575 None None] MFA Rules not processed for user `80558ff481cc4871b5f3f361c42edd17`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:22.752731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-16eee960-f0e6-4549-9d69-435959909575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.771888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 855/1710] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:22.773347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.774236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.774236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.794360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:22.795694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.806749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 856/1711] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:22.807665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:22.809155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.874779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 856/1712] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:22 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:22.874779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81b71-0c01-4b50-b10d-d453f23ba299 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.874779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81b71-0c01-4b50-b10d-d453f23ba299 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.874779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc81b71-0c01-4b50-b10d-d453f23ba299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.914578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3cc81b71-0c01-4b50-b10d-d453f23ba299 None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:22.915592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c79b8-6175-4dea-aa68-ede5c5700190 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:22.918342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3cc81b71-0c01-4b50-b10d-d453f23ba299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:22.920528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:22.921010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:22.921396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:22.921779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:22.932777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:22.959712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:22.988422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 857/1713] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:22 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:22.989384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.040038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3e447-ca20-4cfb-99a5-2c314736c048 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:23.048965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:23.049988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:23.050557 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:23.050992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:23.052085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:23.054655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:23.150152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 858/1714] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:22 2021] POST /identity/v3/projects => generated 407 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:23.152134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.182835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 857/1715] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:48:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:23.186020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81b71-0c01-4b50-b10d-d453f23ba299 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.232019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc81b71-0c01-4b50-b10d-d453f23ba299 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:23.329029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e2eda-8354-4866-a1c6-59482b9aa5bc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:23.346538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:23.347671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:23.350209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:23.350977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:23.351938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:23.353733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:23.355381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:23.384771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:23.385778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:23.387874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:23.388268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:23.389117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:23.392907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 859/1716] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:23.397321 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.400454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:23.468533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 858/1717] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:23 2021] POST /identity/v3/users => generated 304 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:23.469031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.497210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38f9da-27b3-4bd4-8163-bc7708170f88 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:23.514639 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065444fe-ffc8-4578-8080-16f5427d725c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:23.519061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:23.519588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:23.519894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:23.520007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:23.520350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:23.520460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:23.520653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:23.521027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:23.522925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:23.523523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:23.535162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:23.619481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 859/1718] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:23 2021] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:23.620645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.622538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:23.693478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:23.695199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:23.723226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 860/1719] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:23 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:23.726012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.763222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0953c7-4f69-414a-b25d-fe7ddbcb6b12 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:23.795908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421de65-1b14-4f7b-8aea-8792a123b27e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:23.817298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:23.818167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:23.818599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:23.819234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:23.854843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:23.864183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:23.904988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 860/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:23 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:23.916277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:23.936406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:23.988544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:23.989243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:23.989563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:23.989900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:23.990640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:23.992300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.018313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 861/1721] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:24.023903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.051697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a25987-f8fa-465c-b320-b10d27599332 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.074403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.080493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.080853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.081639 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.081900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.084407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.137759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 862/1722] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:24 2021] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:24.137759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.163394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa8b8-1954-45ac-a4f5-c3b15afea6bc service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.173137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.175822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.176122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.176435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] PATH_INFO: `/v3/projects/0d8108f782d14245807c45a1c81e025f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.178079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8108f782d14245807c45a1c81e025f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.180452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.182696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074f9e9-a211-4d2f-b106-ed43f982880d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.215114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.217873 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.223017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.223672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.225858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.230457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.268533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 863/1723] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:24 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:24.270356 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.297346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a06bc-93ba-4749-a0cc-276f1a2cec71 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.325706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8108f782d14245807c45a1c81e025f', 'request_id': 'req-afba3ac8-478a-4d23-afde-a9ff08ca9270'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.351458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8108f782d14245807c45a1c81e025f', 'request_id': 'req-afba3ac8-478a-4d23-afde-a9ff08ca9270'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.375632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8108f782d14245807c45a1c81e025f', 'request_id': 'req-afba3ac8-478a-4d23-afde-a9ff08ca9270'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.409044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.409907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.410211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.410898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.411806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.413612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.423190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] The token cache is being invalidate because project 0d8108f782d14245807c45a1c81e025f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:24.425164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.426489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 864/1724] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:24 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:24.427532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.430173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.431177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:24.436933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 861/1725] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:23 2021] DELETE /identity/v3/projects/0d8108f782d14245807c45a1c81e025f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:24.441861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.445222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:24.467799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba3ac8-478a-4d23-afde-a9ff08ca9270 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.476300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.477646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.477936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.479159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] PATH_INFO: `/v3/projects/fc1a8e90132b42a99de133521fc0ffe1/users/d36670a1340d40489e5cdc2591cc21a4/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.496945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8e0ee-66ce-4498-8e66-fdd265bd29a2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.508438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1a8e90132b42a99de133521fc0ffe1, user_id=d36670a1340d40489e5cdc2591cc21a4, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.510321 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.511274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.511564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.511852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] PATH_INFO: `/v3/users/6dae21ee39ed4d1bbccb30c464940808` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.512717 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.517577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dae21ee39ed4d1bbccb30c464940808)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.522019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.543040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 862/1726] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:24 2021] PUT /identity/v3/projects/fc1a8e90132b42a99de133521fc0ffe1/users/d36670a1340d40489e5cdc2591cc21a4/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:24.543040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.543040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:24.673903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dae21ee39ed4d1bbccb30c464940808'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.675113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dae21ee39ed4d1bbccb30c464940808'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.706078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dae21ee39ed4d1bbccb30c464940808'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.731946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43240c42-0571-4d8c-a594-40649d853908 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:24.733503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dae21ee39ed4d1bbccb30c464940808'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.735366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dae21ee39ed4d1bbccb30c464940808'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:24.758851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:24.759264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:24.759554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:24.759836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:24.762065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:24.764697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:24.808101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 863/1727] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:24 2021] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:24.812811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 865/1728] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:24 2021] DELETE /identity/v3/users/6dae21ee39ed4d1bbccb30c464940808 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:24.813998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.815530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:24.819879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:24.820930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:24.869882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195ff65-52c7-4559-b87a-db75b3c17b9c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:25.015553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:25.016861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:25.017214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:25.017520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] PATH_INFO: `/v3/users/0bf05e9c7f67490ba56571b634670867` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:25.019070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf05e9c7f67490ba56571b634670867)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:25.022091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:25.042937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff613e9-443b-44c0-9561-c2962a332fe7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:25.074813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13287538-518f-423c-9169-84b0726f658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:25.077905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287538-518f-423c-9169-84b0726f658c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:25.079475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287538-518f-423c-9169-84b0726f658c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:25.080600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287538-518f-423c-9169-84b0726f658c admin admin] PATH_INFO: `/v3/projects/8e27fc0b9a834580bcb84c2bd290450c` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:25.084886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13287538-518f-423c-9169-84b0726f658c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e27fc0b9a834580bcb84c2bd290450c)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:25.092171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13287538-518f-423c-9169-84b0726f658c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:25.110534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf05e9c7f67490ba56571b634670867'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.125494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf05e9c7f67490ba56571b634670867'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.146903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf05e9c7f67490ba56571b634670867'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.149778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf05e9c7f67490ba56571b634670867'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.179815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-475b1086-1e3b-43ca-9287-6d2a94f2da5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf05e9c7f67490ba56571b634670867'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.220480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 864/1729] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:24 2021] DELETE /identity/v3/users/0bf05e9c7f67490ba56571b634670867 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:25.220480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:25.220480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:25.220480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:25.236413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13287538-518f-423c-9169-84b0726f658c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e27fc0b9a834580bcb84c2bd290450c', 'request_id': 'req-13287538-518f-423c-9169-84b0726f658c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.261740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13287538-518f-423c-9169-84b0726f658c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e27fc0b9a834580bcb84c2bd290450c', 'request_id': 'req-13287538-518f-423c-9169-84b0726f658c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.280198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13287538-518f-423c-9169-84b0726f658c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e27fc0b9a834580bcb84c2bd290450c', 'request_id': 'req-13287538-518f-423c-9169-84b0726f658c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.317865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13287538-518f-423c-9169-84b0726f658c admin admin] The token cache is being invalidate because project 8e27fc0b9a834580bcb84c2bd290450c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:25.318191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13287538-518f-423c-9169-84b0726f658c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.320958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] MFA Rules not processed for user `d36670a1340d40489e5cdc2591cc21a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:25.321335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:25.323221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13287538-518f-423c-9169-84b0726f658c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.332011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 866/1730] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:24 2021] DELETE /identity/v3/projects/8e27fc0b9a834580bcb84c2bd290450c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:25.333700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:25.333995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:25.334349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:25.401792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:25.409727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:25.546595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 865/1731] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:25 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:25.547572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:25.552565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:25.608684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 867/1732] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:25.608684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:25.619808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:25.685211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322bae6-5347-4669-a9d7-ec3a65f46394 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:25.703446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:25.704312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:25.706603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:25.706603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] PATH_INFO: `/v3/users/b8c75f986f19409c9c25be2d43cb5824` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:25.711876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c75f986f19409c9c25be2d43cb5824)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:25.720745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:25.779161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688db3e0-2e76-4eb3-a444-40c939fb71c1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:25.799727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:25.801435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:25.805837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:25.806510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] PATH_INFO: `/v3/projects/329149e7436b45eb9e0eabf3fe32e38f/users/950827fada094d379984ac8bae6a8fce/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:25.823306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c75f986f19409c9c25be2d43cb5824'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.827763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c75f986f19409c9c25be2d43cb5824'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.837195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329149e7436b45eb9e0eabf3fe32e38f, user_id=950827fada094d379984ac8bae6a8fce, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:25.840211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:25.847089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c75f986f19409c9c25be2d43cb5824'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.864356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 866/1733] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:25 2021] PUT /identity/v3/projects/329149e7436b45eb9e0eabf3fe32e38f/users/950827fada094d379984ac8bae6a8fce/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:25.870775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c75f986f19409c9c25be2d43cb5824'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.871793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:25.872408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c2552ae-b026-41d5-a09c-2482b439d098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c75f986f19409c9c25be2d43cb5824'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:25.877182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:25.918701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 868/1734] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:25 2021] DELETE /identity/v3/users/b8c75f986f19409c9c25be2d43cb5824 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:25.921326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:25.925474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:25.925474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:25.972005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] MFA Rules not processed for user `6363ee6ea7c441ccbd9d8dc5ab30cebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:25.973649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:26.082928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148e72-9254-45c4-88be-3e7bab6da091 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:26.135082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 869/1735] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:25 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:26.136164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:26.141760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:26.213270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c3b91-b83c-4a19-9cd0-fb676196d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:26.214110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c3b91-b83c-4a19-9cd0-fb676196d2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.214560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c3b91-b83c-4a19-9cd0-fb676196d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.214854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c3b91-b83c-4a19-9cd0-fb676196d2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.217173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c3b91-b83c-4a19-9cd0-fb676196d2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:26.218945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c3b91-b83c-4a19-9cd0-fb676196d2c9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:26.281272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00170a0a-80a2-425d-bd2c-72d875506c4e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:26.282346 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 867/1736] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:25 2021] POST /identity/v3/projects => generated 407 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:26.284240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.284542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.288053 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.345187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:26.348062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:26.403370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:26.406813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.407110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.407392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.415498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:26.545955 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 868/1737] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:26.546979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:26.550967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:26.591846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc618e-4fa4-4c2c-922f-839b59bccb86 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:26.607941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:26.608835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.609123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.609452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] PATH_INFO: `/v3/projects/8df014c940b64f6ab42d42d2f4a1cde0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.616029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df014c940b64f6ab42d42d2f4a1cde0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:26.618046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:26.694103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:26.696940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:26.728755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 870/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:26.733123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:26.751235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cdd87-75b8-44e7-a730-f88d3e9bb8fe service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:26.775341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:26.776037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.777604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.777911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.780313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:26.782286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:26.795353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df014c940b64f6ab42d42d2f4a1cde0', 'request_id': 'req-cf667a81-7b54-45ec-bedc-4356dbca559a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:26.807344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df014c940b64f6ab42d42d2f4a1cde0', 'request_id': 'req-cf667a81-7b54-45ec-bedc-4356dbca559a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:26.823330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df014c940b64f6ab42d42d2f4a1cde0', 'request_id': 'req-cf667a81-7b54-45ec-bedc-4356dbca559a'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:26.862617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] The token cache is being invalidate because project 8df014c940b64f6ab42d42d2f4a1cde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:26.862907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 871/1739] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:26 2021] POST /identity/v3/users => generated 310 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:26.863223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:26.864017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:26.867111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:26.869802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 869/1740] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:26 2021] DELETE /identity/v3/projects/8df014c940b64f6ab42d42d2f4a1cde0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:26.870688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:26.872353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:26.887886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0578-a862-4602-b493-5d533c8d61d4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:26.946882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021574d0-96d5-4705-996c-45574729317e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:26.947514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021574d0-96d5-4705-996c-45574729317e service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:26.947798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021574d0-96d5-4705-996c-45574729317e service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:26.948127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021574d0-96d5-4705-996c-45574729317e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:26.950433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-021574d0-96d5-4705-996c-45574729317e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:27.040573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021574d0-96d5-4705-996c-45574729317e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.044471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021574d0-96d5-4705-996c-45574729317e service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.067062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf667a81-7b54-45ec-bedc-4356dbca559a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.070155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 872/1741] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:27.074353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874051-850e-414f-a283-068fe2d53cd4 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.074686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874051-850e-414f-a283-068fe2d53cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.074967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09874051-850e-414f-a283-068fe2d53cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.087727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.091549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.094204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.095266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.096850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.099434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.117059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-09874051-850e-414f-a283-068fe2d53cd4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:27.118456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-09874051-850e-414f-a283-068fe2d53cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:27.143134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 870/1742] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:26 2021] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:27.148087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.149277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 873/1743] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:27.150901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e778-0e83-4333-aaf2-4126f63fd537 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.151197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e778-0e83-4333-aaf2-4126f63fd537 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.152231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e778-0e83-4333-aaf2-4126f63fd537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.186696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c1b3e778-0e83-4333-aaf2-4126f63fd537 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:27.187958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c1b3e778-0e83-4333-aaf2-4126f63fd537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:27.191640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b28218-d5e6-4898-b5eb-a8cd97d7ea28 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.201301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 874/1744] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:27.202398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3e778-0e83-4333-aaf2-4126f63fd537 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.213814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3e778-0e83-4333-aaf2-4126f63fd537 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.215521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.217412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.221734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.222067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.222165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.222247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] PATH_INFO: `/v3/projects/ea6b10ef785e43e3b2a4d7646c1a312e/users/5ccf8d591bca4addb898d69ccaaa8148/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.222333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.222333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.222333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:27.222333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.223713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.250056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 875/1745] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:27.250971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.263244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03b372-43f9-4900-a5a5-54b182a85edb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.269464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.270135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.270421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.270697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.273175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.276070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.313668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6b10ef785e43e3b2a4d7646c1a312e, user_id=5ccf8d591bca4addb898d69ccaaa8148, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.317674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 876/1746] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:27 2021] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:27.319591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.340383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.390160 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 871/1747] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:27 2021] PUT /identity/v3/projects/ea6b10ef785e43e3b2a4d7646c1a312e/users/5ccf8d591bca4addb898d69ccaaa8148/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:27.391339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.396628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d21a3b-b267-48ba-959c-4619100bb62d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.465734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.467025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.467747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.468191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.469037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.471572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.504819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 877/1748] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:27 2021] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:27.507301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.531312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2476d24-812b-4ae9-8523-03180c0453e2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.534946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe2fd3-9ed6-4429-86a5-4795bda05534 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.542645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.543367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.545277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.545597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.546332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.548086 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.549069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.549584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.549684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.551095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.551811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.555011 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.575480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 878/1749] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:27.580376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.583200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 872/1750] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:27.587555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.603474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911a898-bb91-4e1f-8ff8-1b7f5d6dca90 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.608513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b57cd-10ed-43e7-b544-9525f95c4848 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.628528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.629584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.631052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.631341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.631621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] PATH_INFO: `/v3/projects/ea6b10ef785e43e3b2a4d7646c1a312e/users/5ccf8d591bca4addb898d69ccaaa8148/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.632999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.633870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.634149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.634907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.636620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.639052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6b10ef785e43e3b2a4d7646c1a312e, user_id=5ccf8d591bca4addb898d69ccaaa8148, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.641542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.670395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 879/1751] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:27 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:27.681973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.687523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:27.689986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 873/1752] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:27 2021] PUT /identity/v3/projects/ea6b10ef785e43e3b2a4d7646c1a312e/users/5ccf8d591bca4addb898d69ccaaa8148/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:27.691150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:27.724330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a388e-2770-4a18-895a-704b4c0a3a66 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.854392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.855140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.855499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.855814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] PATH_INFO: `/v3/projects/ae69c3303cf84015a9c4718f962b8a84` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.857094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae69c3303cf84015a9c4718f962b8a84)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.859879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.864129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4e99-421d-4a28-8ff2-75bf24bae8a2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:27.885886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105d96e-f086-4e78-9762-f2b53655d021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:27.886994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105d96e-f086-4e78-9762-f2b53655d021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.887295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105d96e-f086-4e78-9762-f2b53655d021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.887585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105d96e-f086-4e78-9762-f2b53655d021 admin admin] PATH_INFO: `/v3/projects/c46327bf68ab4b56ae3b24828f4030f6/users/455e6ffd652e4784a7afa081aacd9fab/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.908270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105d96e-f086-4e78-9762-f2b53655d021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46327bf68ab4b56ae3b24828f4030f6, user_id=455e6ffd652e4784a7afa081aacd9fab, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:27.912853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105d96e-f086-4e78-9762-f2b53655d021 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:27.954929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 874/1753] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:27 2021] PUT /identity/v3/projects/c46327bf68ab4b56ae3b24828f4030f6/users/455e6ffd652e4784a7afa081aacd9fab/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:27.956702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a35f36-d935-4ad5-851c-5803406a1c33 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:27.957570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a35f36-d935-4ad5-851c-5803406a1c33 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:27.957870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a35f36-d935-4ad5-851c-5803406a1c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:27.996852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae69c3303cf84015a9c4718f962b8a84', 'request_id': 'req-86b0c24d-4c65-4376-bdaf-aa868df150b4'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.024214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae69c3303cf84015a9c4718f962b8a84', 'request_id': 'req-86b0c24d-4c65-4376-bdaf-aa868df150b4'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.041193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-17a35f36-d935-4ad5-851c-5803406a1c33 None None] MFA Rules not processed for user `5ccf8d591bca4addb898d69ccaaa8148`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:28.041416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae69c3303cf84015a9c4718f962b8a84', 'request_id': 'req-86b0c24d-4c65-4376-bdaf-aa868df150b4'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.043167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-17a35f36-d935-4ad5-851c-5803406a1c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:28.081254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] The token cache is being invalidate because project ae69c3303cf84015a9c4718f962b8a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:28.081578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.084649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.093563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 880/1754] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:27 2021] DELETE /identity/v3/projects/ae69c3303cf84015a9c4718f962b8a84 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:28.093563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:28.105396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:28.127545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 875/1755] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:27 2021] POST /identity/v3/auth/tokens => generated 3494 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:28.129258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:28.129674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:28.130114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:28.165489 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] MFA Rules not processed for user `455e6ffd652e4784a7afa081aacd9fab`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:28.167133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:28.259537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c24d-4c65-4376-bdaf-aa868df150b4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:28.268508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:28.272776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 876/1756] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:28 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:28.273966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:28.284901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:28.285191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:28.285191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:28.285191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] PATH_INFO: `/v3/projects/46b780e687e04476a9390cd2fbcffb5b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:28.285191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b780e687e04476a9390cd2fbcffb5b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:28.285191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:28.324097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea21874-4286-4fd0-9551-0b6d5fa83f28 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:28.340448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:28.341712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:28.341958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:28.342217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] PATH_INFO: `/v3/users/7e2cbf4d2b824dd29290e4802295d2ee` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:28.350628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2cbf4d2b824dd29290e4802295d2ee)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:28.352589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:28.437938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2cbf4d2b824dd29290e4802295d2ee'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.452297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b780e687e04476a9390cd2fbcffb5b', 'request_id': 'req-344e13bb-cad5-4844-a1cb-b427b0d12d28'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.453606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2cbf4d2b824dd29290e4802295d2ee'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.466264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b780e687e04476a9390cd2fbcffb5b', 'request_id': 'req-344e13bb-cad5-4844-a1cb-b427b0d12d28'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.476595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b780e687e04476a9390cd2fbcffb5b', 'request_id': 'req-344e13bb-cad5-4844-a1cb-b427b0d12d28'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.481999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2cbf4d2b824dd29290e4802295d2ee'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.482888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2cbf4d2b824dd29290e4802295d2ee'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.501230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2cbf4d2b824dd29290e4802295d2ee'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.510964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 877/1757] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:28 2021] DELETE /identity/v3/users/7e2cbf4d2b824dd29290e4802295d2ee => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:28.512045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:28.512226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] The token cache is being invalidate because project 46b780e687e04476a9390cd2fbcffb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:28.512677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.513986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:28.519288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:28.526878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 881/1758] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:28 2021] DELETE /identity/v3/projects/46b780e687e04476a9390cd2fbcffb5b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:28.526878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:28.531338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:28.751960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e13bb-cad5-4844-a1cb-b427b0d12d28 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:28.809815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2b473-7702-4d85-86e7-10b06dab536d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:28.814146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e8ed2-10ce-4a3c-8e78-4fa6f6604337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:28.814880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8ed2-10ce-4a3c-8e78-4fa6f6604337 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:28.815327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8ed2-10ce-4a3c-8e78-4fa6f6604337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:28.815825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e8ed2-10ce-4a3c-8e78-4fa6f6604337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:28.817991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-667e8ed2-10ce-4a3c-8e78-4fa6f6604337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:28.887776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:28.898961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:28.900546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:28.900782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:28.907978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:28.917361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:28.951202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e8ed2-10ce-4a3c-8e78-4fa6f6604337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:28.954612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e8ed2-10ce-4a3c-8e78-4fa6f6604337 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:28.989153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 878/1759] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:28 2021] GET /identity/v3/auth/tokens => generated 3494 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:28.992981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:28.993442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:28.994326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:28.995979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 882/1760] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:28 2021] POST /identity/v3/projects => generated 367 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:29.002646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:29.039812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:29.042146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.211930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 879/1761] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:29.212963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:29.214651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.230502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bc54f-431e-48e8-9e54-e0d5d6c8118c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:29.241823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309a808-ac7d-4a1e-b97f-5f32ebcc67e1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:29.243464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:29.245482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.246244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.247103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] PATH_INFO: `/v3/projects/e507c5a4b9d04649a2f0547331444de9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.249274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444edad-3b7a-4a16-bc2e-d35448b94586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:29.250161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=e507c5a4b9d04649a2f0547331444de9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:29.250667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444edad-3b7a-4a16-bc2e-d35448b94586 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.251107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444edad-3b7a-4a16-bc2e-d35448b94586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.251538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444edad-3b7a-4a16-bc2e-d35448b94586 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.252408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444edad-3b7a-4a16-bc2e-d35448b94586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:29.254748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444edad-3b7a-4a16-bc2e-d35448b94586 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:29.255894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:29.322172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 883/1762] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:28 2021] POST /identity/v3/users => generated 290 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:29.325101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883276d-35a7-4e30-9930-535299547829 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.325429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883276d-35a7-4e30-9930-535299547829 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.325724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883276d-35a7-4e30-9930-535299547829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.346756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e507c5a4b9d04649a2f0547331444de9', 'request_id': 'req-0c84c185-6f16-4723-8be6-2965ecbc6bda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:29.364875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e507c5a4b9d04649a2f0547331444de9', 'request_id': 'req-0c84c185-6f16-4723-8be6-2965ecbc6bda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:29.390617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9883276d-35a7-4e30-9930-535299547829 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:29.397799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9883276d-35a7-4e30-9930-535299547829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.402855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e507c5a4b9d04649a2f0547331444de9', 'request_id': 'req-0c84c185-6f16-4723-8be6-2965ecbc6bda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:29.428616 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] The token cache is being invalidate because project e507c5a4b9d04649a2f0547331444de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:29.442541 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:29.447437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:29.450023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 880/1763] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:29 2021] DELETE /identity/v3/projects/e507c5a4b9d04649a2f0547331444de9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:29.451016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:29.461854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.616594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 884/1764] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:29.618747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.619048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.619624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.645301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:29.647166 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.658932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 885/1765] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:29.659807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:29.661874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.688874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c185-6f16-4723-8be6-2965ecbc6bda admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:29.695068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:29.695982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.696456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.696920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.697965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:29.699797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:29.715273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 881/1766] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:29 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:29.716722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:29.749691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263140f-be04-4bd4-8cf7-c54a39738c87 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:29.765785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdea50c-e8a9-4373-ab72-c7bc9fdd62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:29.766614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea50c-e8a9-4373-ab72-c7bc9fdd62ed admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.767011 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea50c-e8a9-4373-ab72-c7bc9fdd62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.767404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea50c-e8a9-4373-ab72-c7bc9fdd62ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.768373 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdea50c-e8a9-4373-ab72-c7bc9fdd62ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:29.768713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f707c-e99e-4096-a995-0c373d5eb706 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:29.768824 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdea50c-e8a9-4373-ab72-c7bc9fdd62ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:29.770925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdea50c-e8a9-4373-ab72-c7bc9fdd62ed admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:29.773760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a8be1-9e7c-4502-8bf7-17381400d835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:29.775072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a8be1-9e7c-4502-8bf7-17381400d835 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.775436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a8be1-9e7c-4502-8bf7-17381400d835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.775799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a8be1-9e7c-4502-8bf7-17381400d835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.777857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e16a8be1-9e7c-4502-8bf7-17381400d835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.789503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 882/1767] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:29.789503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2339c-44ac-42e5-b822-bc396125687f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.789503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2339c-44ac-42e5-b822-bc396125687f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.789503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2339c-44ac-42e5-b822-bc396125687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.810305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0be2339c-44ac-42e5-b822-bc396125687f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:29.811676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0be2339c-44ac-42e5-b822-bc396125687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.822857 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 883/1768] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:29.824026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2339c-44ac-42e5-b822-bc396125687f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:29.841411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2339c-44ac-42e5-b822-bc396125687f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:29.857739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:29.858785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.860332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.860700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] PATH_INFO: `/v3/projects/702e9d1f86bd4881a2fc8d1c1fb7ef4e/users/77b72f004b6e4a3f9d2b839888bbc680/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.881935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a8be1-9e7c-4502-8bf7-17381400d835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:29.881935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a8be1-9e7c-4502-8bf7-17381400d835 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:29.897890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 886/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:29 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:29.899373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f85e78-9da9-4734-913f-4e01e49b09d3 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:29.899669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f85e78-9da9-4734-913f-4e01e49b09d3 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:29.899954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f85e78-9da9-4734-913f-4e01e49b09d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:29.912123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] RBAC: Authorizing `identity:create_grant(project_id=702e9d1f86bd4881a2fc8d1c1fb7ef4e, user_id=77b72f004b6e4a3f9d2b839888bbc680, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:29.923120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:29.955599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-57f85e78-9da9-4734-913f-4e01e49b09d3 None None] MFA Rules not processed for user `950827fada094d379984ac8bae6a8fce`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:29.957355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-57f85e78-9da9-4734-913f-4e01e49b09d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:29.973422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 884/1770] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:29 2021] PUT /identity/v3/projects/702e9d1f86bd4881a2fc8d1c1fb7ef4e/users/77b72f004b6e4a3f9d2b839888bbc680/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:29.973422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.070782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 887/1771] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:30.071874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f85e78-9da9-4734-913f-4e01e49b09d3 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.119279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde7278-af1b-4086-b877-77ec4b71140d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.125074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.126089 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.126605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.127085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.127997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.130265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.138690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f85e78-9da9-4734-913f-4e01e49b09d3 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.144465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.145231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.145615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.146008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.146816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:30.147193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.148888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.163858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 888/1772] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:30.164828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.165732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 885/1773] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:29 2021] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:30.167876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.169944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:30.182597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f131e7f-ab58-472d-a9bd-a981a037a162 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.279853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560145-ca31-4d22-b279-4b57e317ad66 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.293584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.294272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.294561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.294843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.295568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.299418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.302048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.303443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.303758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.304249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.304778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.307061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.327179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 889/1774] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:30.328326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.352542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aff389-c089-4480-ad0a-a01a8acdffc0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.363567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 886/1775] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:30 2021] POST /identity/v3/projects => generated 403 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:30.363567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.369083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.369857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.370056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.370334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.371042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.372931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.418737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 890/1776] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:30 2021] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:30.419618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.461891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff73e19-aaf3-4292-89e8-ec2d42643c2e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.496626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc68c57-b22f-4ac2-9a26-84069ec35d42 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.501417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.502336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.502623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.502910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] PATH_INFO: `/v3/projects/702e9d1f86bd4881a2fc8d1c1fb7ef4e/users/77b72f004b6e4a3f9d2b839888bbc680/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.504888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702e9d1f86bd4881a2fc8d1c1fb7ef4e, user_id=77b72f004b6e4a3f9d2b839888bbc680, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.507615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.517749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 891/1777] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:30 2021] PUT /identity/v3/projects/702e9d1f86bd4881a2fc8d1c1fb7ef4e/users/77b72f004b6e4a3f9d2b839888bbc680/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:30.526390 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.526515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.526515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.526515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.526515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.526880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.526880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.547367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 887/1778] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:30 2021] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:30.547367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.555677 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e74f4-8070-4027-8cd8-75f96cca5db5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.577928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b5327-c605-492b-bcf0-6acd29900fc7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.582614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f6db4-d3f4-4e65-8802-76687cb25c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.583308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6db4-d3f4-4e65-8802-76687cb25c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.583620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6db4-d3f4-4e65-8802-76687cb25c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.583901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f6db4-d3f4-4e65-8802-76687cb25c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.584606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6db4-d3f4-4e65-8802-76687cb25c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.586568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f6db4-d3f4-4e65-8802-76687cb25c00 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.610657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 892/1779] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:30 2021] POST /identity/v3/users => generated 308 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:30.610657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841eff-d8d0-4170-8ae9-2fb46b46a77f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.610657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841eff-d8d0-4170-8ae9-2fb46b46a77f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.610657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841eff-d8d0-4170-8ae9-2fb46b46a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.612845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.613560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.613971 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.614260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.615837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.617796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.635516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-40841eff-d8d0-4170-8ae9-2fb46b46a77f None None] MFA Rules not processed for user `77b72f004b6e4a3f9d2b839888bbc680`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:30.636726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-40841eff-d8d0-4170-8ae9-2fb46b46a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:30.637326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 888/1780] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:30 2021] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:30.638221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.649986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d2841-7c85-45a2-8375-789326c52b33 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.654555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.655201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.655493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.655777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.656506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.658139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.668615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 889/1781] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:30.669444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.679322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1a34-0c80-4410-9677-795aefe89df8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.684127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.684791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.685083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.685410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.686425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.688378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.698945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 890/1782] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:30.699759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.713352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833192d-7f3f-437c-9ace-cd18c90eb793 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.720027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.721069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.721361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.721670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.722533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.724076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.732110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 893/1783] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:30 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:30.734038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40841eff-d8d0-4170-8ae9-2fb46b46a77f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.747461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40841eff-d8d0-4170-8ae9-2fb46b46a77f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.752003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 891/1784] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:30.752003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.754111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.754941 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.755266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.755556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.756539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.758911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.763667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e2861-db7e-45b6-97da-ac0d8f80ad6b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.770295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.772163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.772499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.773077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] PATH_INFO: `/v3/projects/b9633ac9a562417ba4f0bbd496f591c9/users/77d6e369e65e4b7c869626aeccf9097c/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.782434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 894/1785] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:30.782434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.791052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9633ac9a562417ba4f0bbd496f591c9, user_id=77d6e369e65e4b7c869626aeccf9097c, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.793798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.809323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 892/1786] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:30 2021] PUT /identity/v3/projects/b9633ac9a562417ba4f0bbd496f591c9/users/77d6e369e65e4b7c869626aeccf9097c/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:30.809902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.863507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3564e-f468-4f2c-9a26-185da10e11d6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.903301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68a2f0-79ba-4ddf-a747-9518a0e72504 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.908485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.909157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.909475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.909752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.910598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.912384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.922143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.922836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.923061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.923344 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.924883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 893/1787] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:30.926235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:30.940074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc55300-14e5-4479-8ac2-6a61de527e75 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:30.948796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:30.950027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:30.950315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:30.950595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] PATH_INFO: `/v3/projects/3420eb1f7960443d8e25a0fa6329ccc6/users/4ca31e31f9ea4540a457ed556d2f2938/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:30.969314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3420eb1f7960443d8e25a0fa6329ccc6, user_id=4ca31e31f9ea4540a457ed556d2f2938, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:30.972650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:30.995429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 894/1788] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:30 2021] PUT /identity/v3/projects/3420eb1f7960443d8e25a0fa6329ccc6/users/4ca31e31f9ea4540a457ed556d2f2938/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:30.995429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.021714 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.023262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.034027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 895/1789] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:31.034875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.046407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c5fb8-9a11-4078-8d12-736a7991a551 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:31.063182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bb4f3-c646-4d2d-8087-7620b46ab9ba admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:31.071704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecba19-eddb-4277-8c5c-99f6a9faf703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:31.071704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecba19-eddb-4277-8c5c-99f6a9faf703 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.072035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecba19-eddb-4277-8c5c-99f6a9faf703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.072333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecba19-eddb-4277-8c5c-99f6a9faf703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.073088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecba19-eddb-4277-8c5c-99f6a9faf703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.075634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecba19-eddb-4277-8c5c-99f6a9faf703 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.091209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 895/1790] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:31.091209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.091209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.091209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.111818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:31.112706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.112989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.113260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] PATH_INFO: `/v3/projects/c7f7a440878d4944bffb65a35a00f330/users/ce17c1a630e44d81b42ce5d496c9d942/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.127632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] MFA Rules not processed for user `4ca31e31f9ea4540a457ed556d2f2938`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:31.127981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f7a440878d4944bffb65a35a00f330, user_id=ce17c1a630e44d81b42ce5d496c9d942, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.129065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:31.130855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.144722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 896/1791] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:31 2021] PUT /identity/v3/projects/c7f7a440878d4944bffb65a35a00f330/users/ce17c1a630e44d81b42ce5d496c9d942/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:31.145644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.201317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 896/1792] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:31 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:31.202469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.204014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:31.219389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933252b-5915-4ac7-9b47-7cc9532d42c0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:31.224677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa337a4-847f-428d-a2c1-2141bbb40443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:31.225591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa337a4-847f-428d-a2c1-2141bbb40443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.226005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa337a4-847f-428d-a2c1-2141bbb40443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.226288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa337a4-847f-428d-a2c1-2141bbb40443 admin admin] PATH_INFO: `/v3/projects/b9633ac9a562417ba4f0bbd496f591c9/users/77d6e369e65e4b7c869626aeccf9097c/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.228350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa337a4-847f-428d-a2c1-2141bbb40443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9633ac9a562417ba4f0bbd496f591c9, user_id=77d6e369e65e4b7c869626aeccf9097c, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.231045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa337a4-847f-428d-a2c1-2141bbb40443 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.246565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 897/1793] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:31 2021] PUT /identity/v3/projects/b9633ac9a562417ba4f0bbd496f591c9/users/77d6e369e65e4b7c869626aeccf9097c/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:31.247879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0bd2c-6543-4029-b560-39f187387b8c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.248340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0bd2c-6543-4029-b560-39f187387b8c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.248623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0bd2c-6543-4029-b560-39f187387b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.277043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-24d0bd2c-6543-4029-b560-39f187387b8c None None] MFA Rules not processed for user `ce17c1a630e44d81b42ce5d496c9d942`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:31.278474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-24d0bd2c-6543-4029-b560-39f187387b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:31.280315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c26d0-4862-4af8-b703-5e4c350dbaf6 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:31.336068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:31.336743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.337229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.337559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.343561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:31.368696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 898/1794] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:31 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:31.369594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0bd2c-6543-4029-b560-39f187387b8c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.447509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.451062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.466769 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 897/1795] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:31 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:31.469629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.484789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455f470-9341-48d9-adc7-89c9eb5bff71 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:31.489223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:31.490033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.490386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.490737 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.512911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.515157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.534573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 898/1796] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:31 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:31.561481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.571829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0bd2c-6543-4029-b560-39f187387b8c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:31.588618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:31.589388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.589772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.590604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.591146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.593136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.603660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c64a37-8303-47ee-936e-27dd44ea4a2a service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:31.615164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:31.616354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.616984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.618932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] PATH_INFO: `/v3/users/ce17c1a630e44d81b42ce5d496c9d942` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.631159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce17c1a630e44d81b42ce5d496c9d942)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:31.634007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:31.682893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 899/1797] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:31 2021] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:31.687454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:31.777209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce17c1a630e44d81b42ce5d496c9d942'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:31.810814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce17c1a630e44d81b42ce5d496c9d942'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:31.819617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce17c1a630e44d81b42ce5d496c9d942'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:31.820585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce17c1a630e44d81b42ce5d496c9d942'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:31.845385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9c94b278-36c9-4aeb-bb75-6be103ca3954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce17c1a630e44d81b42ce5d496c9d942'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:31.865664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 899/1798] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:31 2021] DELETE /identity/v3/users/ce17c1a630e44d81b42ce5d496c9d942 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:31.867134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:31.870313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:31.870564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:31.916569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:31.917861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:31.918387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1c806-d9ab-4a07-95b8-da09f40499e1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:32.063146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:32.065996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.068835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.069241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.070105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:32.070350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 900/1799] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:32.076245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:32.123186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 900/1800] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:31 2021] POST /identity/v3/users => generated 299 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:32.127008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:32.128456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:32.151117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d390a8-236e-4a2f-a151-b39f72da5624 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:32.179349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:32.180044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.180329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.180603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.181358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:32.189770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:32.202346 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 901/1801] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:32 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:32.207236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:32.209712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:32.210559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:32.232296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a46f8-2f5e-4a13-90fb-98fe455f49c5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:32.239589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:32.240556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.240838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.241164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] PATH_INFO: `/v3/projects/64a7bac71d6140e0a25b91dce0fc8bae/users/34977a7224c74b2f817a6fac92686db9/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.277309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a7bac71d6140e0a25b91dce0fc8bae, user_id=34977a7224c74b2f817a6fac92686db9, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:32.280398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:32.288239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cbc13-91ca-4fd8-a152-a77db2bbc229 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:32.293435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:32.295303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.296459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.296575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.303553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 902/1802] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:32 2021] PUT /identity/v3/projects/64a7bac71d6140e0a25b91dce0fc8bae/users/34977a7224c74b2f817a6fac92686db9/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:32.307720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:32.308710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:32.310670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:32.321712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 901/1803] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:32.387968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a346d37-543d-459a-8a28-a7da85e8581a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:32.392961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605f549-e919-4674-a058-2678cdcaf317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:32.393682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f549-e919-4674-a058-2678cdcaf317 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.393973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f549-e919-4674-a058-2678cdcaf317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.394255 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f549-e919-4674-a058-2678cdcaf317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.395004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605f549-e919-4674-a058-2678cdcaf317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:32.397219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605f549-e919-4674-a058-2678cdcaf317 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:32.412697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 903/1804] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:32 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:32.414143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:32.426279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b56101-4d6d-4c25-b3a1-1135f1483374 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:32.444402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:32.445584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.446144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.446254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] PATH_INFO: `/v3/projects/64a7bac71d6140e0a25b91dce0fc8bae/users/34977a7224c74b2f817a6fac92686db9/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.451941 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a7bac71d6140e0a25b91dce0fc8bae, user_id=34977a7224c74b2f817a6fac92686db9, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:32.455886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:32.480068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 902/1805] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:32 2021] PUT /identity/v3/projects/64a7bac71d6140e0a25b91dce0fc8bae/users/34977a7224c74b2f817a6fac92686db9/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:32.487085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319f459-8149-491b-a11e-6025433c1f3b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.487382 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319f459-8149-491b-a11e-6025433c1f3b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.487733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319f459-8149-491b-a11e-6025433c1f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.531165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d319f459-8149-491b-a11e-6025433c1f3b None None] MFA Rules not processed for user `34977a7224c74b2f817a6fac92686db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:32.532574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d319f459-8149-491b-a11e-6025433c1f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:32.683575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 904/1806] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:32 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:32.695843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:32.698207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:32.786173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea81cf-fcce-49a5-a3df-2bc0bf6279f6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:32.790675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527c8cd-5132-46e6-bce5-b5aa5a02b455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:32.791601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c8cd-5132-46e6-bce5-b5aa5a02b455 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:32.792235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c8cd-5132-46e6-bce5-b5aa5a02b455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:32.792775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c8cd-5132-46e6-bce5-b5aa5a02b455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:32.804969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527c8cd-5132-46e6-bce5-b5aa5a02b455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:32.806719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527c8cd-5132-46e6-bce5-b5aa5a02b455 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:32.820892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 903/1807] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:32 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:32.890581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319f459-8149-491b-a11e-6025433c1f3b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:33.019898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319f459-8149-491b-a11e-6025433c1f3b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:33.039071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:33.040177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:33.040361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:33.040721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] PATH_INFO: `/v3/users/4ca31e31f9ea4540a457ed556d2f2938` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:33.043876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca31e31f9ea4540a457ed556d2f2938)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:33.046410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:33.075259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:33.076405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:33.076931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:33.112440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] MFA Rules not processed for user `77d6e369e65e4b7c869626aeccf9097c`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:33.114085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:33.128102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca31e31f9ea4540a457ed556d2f2938'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.143520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca31e31f9ea4540a457ed556d2f2938'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.159490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca31e31f9ea4540a457ed556d2f2938'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.160300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca31e31f9ea4540a457ed556d2f2938'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.174703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f239586b-f997-4e5f-9639-65f0db333e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca31e31f9ea4540a457ed556d2f2938'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.186286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 905/1808] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:32 2021] DELETE /identity/v3/users/4ca31e31f9ea4540a457ed556d2f2938 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:33.187571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:33.187866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:33.188153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:33.199651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 904/1809] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:33.222519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:33.223753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:33.328404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 906/1810] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:33.341858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:33.344806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:33.461405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f862fe-bae5-4c9f-95ac-32bb1d31c51e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:33.540624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9f3b-844c-4567-a535-3e20c759f170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:33.541638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9f3b-844c-4567-a535-3e20c759f170 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:33.542134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9f3b-844c-4567-a535-3e20c759f170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:33.542613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9f3b-844c-4567-a535-3e20c759f170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:33.561691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c9f3b-844c-4567-a535-3e20c759f170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:33.571362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c9f3b-844c-4567-a535-3e20c759f170 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:33.585277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 905/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:33.588404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:33.595307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:33.618516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c2a7d-9b8c-4c2d-82b7-a8bfdf0aed7c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:33.636647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:33.637330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:33.637646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:33.637892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] PATH_INFO: `/v3/projects/c7f7a440878d4944bffb65a35a00f330` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:33.639810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f7a440878d4944bffb65a35a00f330)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:33.644206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:33.719604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f7a440878d4944bffb65a35a00f330', 'request_id': 'req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.732435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f7a440878d4944bffb65a35a00f330', 'request_id': 'req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.746494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f7a440878d4944bffb65a35a00f330', 'request_id': 'req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.759777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] The token cache is being invalidate because project c7f7a440878d4944bffb65a35a00f330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:33.760241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.760920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b9b83591-9bc7-4c22-bcaa-aa12d6cddd14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:33.764367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 907/1812] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:33 2021] DELETE /identity/v3/projects/c7f7a440878d4944bffb65a35a00f330 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:33.769093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73450d0-e641-4343-9ad9-5911f8da4a35 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:33.769489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73450d0-e641-4343-9ad9-5911f8da4a35 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:33.769996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73450d0-e641-4343-9ad9-5911f8da4a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:33.801539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b73450d0-e641-4343-9ad9-5911f8da4a35 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:33.802912 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b73450d0-e641-4343-9ad9-5911f8da4a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:33.961260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 906/1813] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:33.969563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd212-2d31-45d5-ba6d-600685f7c38d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:33.970129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd212-2d31-45d5-ba6d-600685f7c38d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:33.970508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd212-2d31-45d5-ba6d-600685f7c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:33.991340 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-240dd212-2d31-45d5-ba6d-600685f7c38d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:33.992587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-240dd212-2d31-45d5-ba6d-600685f7c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:34.007175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 908/1814] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:34.012242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73450d0-e641-4343-9ad9-5911f8da4a35 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.023792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73450d0-e641-4343-9ad9-5911f8da4a35 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.029865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.030644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.030999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.031351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.032194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:34.032567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.034899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.058272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 907/1815] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:34.062564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dd212-2d31-45d5-ba6d-600685f7c38d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.081218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dd212-2d31-45d5-ba6d-600685f7c38d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.088570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.089660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.090129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.090508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.091686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.094421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.126699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 909/1816] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:34 2021] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:34.130983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.152976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c949f-7fec-4f81-a38e-b732be9fd388 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.232989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.233854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.236112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.236473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.238213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.239988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.265937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 908/1817] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:34 2021] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:34.268240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.280616 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dfeaf-1e42-4a15-a9ce-a99406804382 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.288405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.289171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.289561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.289944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.290759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.292650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.304747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 910/1818] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:34 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:34.308934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.319853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57a4dc-9719-48f6-b229-6db5d55bc0d1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.324840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.325529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.325815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.326367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.326831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.328401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.340149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 909/1819] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:34.344456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.358459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d4bfc-2644-4359-9a60-d8de477f323c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.363583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad488ad-8e61-4005-a597-45d7a30f0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.365206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad488ad-8e61-4005-a597-45d7a30f0a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.365522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad488ad-8e61-4005-a597-45d7a30f0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.365799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad488ad-8e61-4005-a597-45d7a30f0a03 admin admin] PATH_INFO: `/v3/projects/ef1306d937bb4dcbb776fce2852dfa47/users/f87c59dedb34461a97059bbbee67914e/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.377124 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.379059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:34.384346 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad488ad-8e61-4005-a597-45d7a30f0a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1306d937bb4dcbb776fce2852dfa47, user_id=f87c59dedb34461a97059bbbee67914e, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.387163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad488ad-8e61-4005-a597-45d7a30f0a03 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.403835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 911/1820] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:34 2021] PUT /identity/v3/projects/ef1306d937bb4dcbb776fce2852dfa47/users/f87c59dedb34461a97059bbbee67914e/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:34.411190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42583a-6140-46e1-8456-280840b1063c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.414130 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63bae-b36f-4019-bd05-8f1aba798c55 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.414723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63bae-b36f-4019-bd05-8f1aba798c55 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.414956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63bae-b36f-4019-bd05-8f1aba798c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.455628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c8a63bae-b36f-4019-bd05-8f1aba798c55 None None] MFA Rules not processed for user `f87c59dedb34461a97059bbbee67914e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:34.457005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c8a63bae-b36f-4019-bd05-8f1aba798c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:34.492088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.493313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.493711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.494003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] PATH_INFO: `/v3/projects/3420eb1f7960443d8e25a0fa6329ccc6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.495222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3420eb1f7960443d8e25a0fa6329ccc6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.497277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.530899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 912/1821] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:34 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:34.535009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a63bae-b36f-4019-bd05-8f1aba798c55 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.549555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a63bae-b36f-4019-bd05-8f1aba798c55 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.565638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3420eb1f7960443d8e25a0fa6329ccc6', 'request_id': 'req-cab5e69e-127c-46e4-a6e7-da39004b727d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.580378 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3420eb1f7960443d8e25a0fa6329ccc6', 'request_id': 'req-cab5e69e-127c-46e4-a6e7-da39004b727d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.587512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3420eb1f7960443d8e25a0fa6329ccc6', 'request_id': 'req-cab5e69e-127c-46e4-a6e7-da39004b727d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.609104 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] The token cache is being invalidate because project 3420eb1f7960443d8e25a0fa6329ccc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:34.609602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.611210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.614018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 910/1822] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:34 2021] DELETE /identity/v3/projects/3420eb1f7960443d8e25a0fa6329ccc6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:34.618363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.622251 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:34.642283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.643221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.643759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.643961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.644706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.646688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.681194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 913/1823] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:34 2021] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:34.683088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.684844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:34.688788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e69e-127c-46e4-a6e7-da39004b727d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.750591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.751492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.751776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.752054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] PATH_INFO: `/v3/users/34977a7224c74b2f817a6fac92686db9` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.752535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a049-8ade-4804-87fa-56bcdb3314e4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.753418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34977a7224c74b2f817a6fac92686db9)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.756061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.761110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.761978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.762408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.762795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.763892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.765970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.795137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 914/1824] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:34 2021] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:34.796232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.809317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39d363-18d9-4153-9643-970f9bffdd80 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.816024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.816785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.817104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.817486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.818390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.820181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.826692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34977a7224c74b2f817a6fac92686db9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.827904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34977a7224c74b2f817a6fac92686db9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.835823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34977a7224c74b2f817a6fac92686db9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.835988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 915/1825] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:34 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:34.836940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.838681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:34.846806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34977a7224c74b2f817a6fac92686db9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.848101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34977a7224c74b2f817a6fac92686db9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.852407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a9621-e1b6-492d-a865-dd7732d852fd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.857587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.858452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.858841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.859041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] PATH_INFO: `/v3/users/950827fada094d379984ac8bae6a8fce` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.860235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950827fada094d379984ac8bae6a8fce)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.862171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.865898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 911/1826] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:34 2021] DELETE /identity/v3/users/34977a7224c74b2f817a6fac92686db9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:34.866674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.868159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:34.919701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950827fada094d379984ac8bae6a8fce'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.935768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950827fada094d379984ac8bae6a8fce'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.938180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc4641-bc1f-4725-a169-282b11c8cbb2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:34.943993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:34.944938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:34.945228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:34.945537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] PATH_INFO: `/v3/projects/1065d4d05a044883b642232fabbb3aab/users/7a960783ef6d4483a4aedebd5a3e22ef/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:34.947001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950827fada094d379984ac8bae6a8fce'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.948148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950827fada094d379984ac8bae6a8fce'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.961883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065d4d05a044883b642232fabbb3aab, user_id=7a960783ef6d4483a4aedebd5a3e22ef, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:34.964679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:34.976156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950827fada094d379984ac8bae6a8fce'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:34.982928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 916/1827] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:34 2021] DELETE /identity/v3/users/950827fada094d379984ac8bae6a8fce => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:34.988075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 912/1828] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:34 2021] PUT /identity/v3/projects/1065d4d05a044883b642232fabbb3aab/users/7a960783ef6d4483a4aedebd5a3e22ef/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:34.995109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:34.995109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:35.080625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e5b1-450c-40da-80c6-193b854ac270 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:35.087908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f017a9-7aa9-4441-8d57-f93f11bf4279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:35.090394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f017a9-7aa9-4441-8d57-f93f11bf4279 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:35.090394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f017a9-7aa9-4441-8d57-f93f11bf4279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:35.090394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f017a9-7aa9-4441-8d57-f93f11bf4279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:35.090394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f017a9-7aa9-4441-8d57-f93f11bf4279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:35.092860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f017a9-7aa9-4441-8d57-f93f11bf4279 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:35.109323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 917/1829] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:34 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:35.109921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:35.245645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34b6d4-b8a0-4c0e-9c2b-8227786c9723 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:35.253280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:35.254175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:35.254450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:35.254736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] PATH_INFO: `/v3/projects/1065d4d05a044883b642232fabbb3aab/users/7a960783ef6d4483a4aedebd5a3e22ef/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:35.257708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1065d4d05a044883b642232fabbb3aab, user_id=7a960783ef6d4483a4aedebd5a3e22ef, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:35.261241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:35.276083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 913/1830] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:35 2021] PUT /identity/v3/projects/1065d4d05a044883b642232fabbb3aab/users/7a960783ef6d4483a4aedebd5a3e22ef/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:35.287572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:35.287910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:35.288638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:35.333657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] MFA Rules not processed for user `7a960783ef6d4483a4aedebd5a3e22ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:35.335647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:35.438224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 918/1831] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:35 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:35.445099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:35.446951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:35.495315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:35.497048 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:35.538753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58cb98-49fa-406a-b5da-780426d786c5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:35.542764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:35.543733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:35.544114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:35.544500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:35.547889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:35.654785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b865b-d3cb-430c-bb83-8c7778be0cda None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:35.659345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:35.661096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:35.662970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:35.663326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:35.663612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] PATH_INFO: `/v3/projects/329149e7436b45eb9e0eabf3fe32e38f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:35.663948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:35.665020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=329149e7436b45eb9e0eabf3fe32e38f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:35.668250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:35.695897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 914/1832] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:35 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:35.739080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329149e7436b45eb9e0eabf3fe32e38f', 'request_id': 'req-887828b5-4832-4136-a375-6e7a61f9a7ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.747156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:35.750219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:35.753255 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329149e7436b45eb9e0eabf3fe32e38f', 'request_id': 'req-887828b5-4832-4136-a375-6e7a61f9a7ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.761940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329149e7436b45eb9e0eabf3fe32e38f', 'request_id': 'req-887828b5-4832-4136-a375-6e7a61f9a7ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.776299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] The token cache is being invalidate because project 329149e7436b45eb9e0eabf3fe32e38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:35.776884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.778250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.779468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c00d7-352a-4aef-8661-ad167e988bd8 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:35.780855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 919/1833] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:35 2021] DELETE /identity/v3/projects/329149e7436b45eb9e0eabf3fe32e38f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:35.785444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:35.787715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:35.868174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887828b5-4832-4136-a375-6e7a61f9a7ab admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:35.874994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:35.876708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:35.877301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:35.877777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] PATH_INFO: `/v3/users/77d6e369e65e4b7c869626aeccf9097c` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:35.879309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d6e369e65e4b7c869626aeccf9097c)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:35.881758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:35.902717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:35.903995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:35.905996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:35.906486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] PATH_INFO: `/v3/projects/64a7bac71d6140e0a25b91dce0fc8bae` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:35.909423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a7bac71d6140e0a25b91dce0fc8bae)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:35.916628 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:35.951710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d6e369e65e4b7c869626aeccf9097c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.965242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d6e369e65e4b7c869626aeccf9097c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.982261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d6e369e65e4b7c869626aeccf9097c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:35.984529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d6e369e65e4b7c869626aeccf9097c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.006236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d6e369e65e4b7c869626aeccf9097c'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.025864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 920/1834] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:35 2021] DELETE /identity/v3/users/77d6e369e65e4b7c869626aeccf9097c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:36.025864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.025864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:36.034929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a7bac71d6140e0a25b91dce0fc8bae', 'request_id': 'req-c2ed5986-01f5-447f-b216-7028dccd2fb6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.066328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a7bac71d6140e0a25b91dce0fc8bae', 'request_id': 'req-c2ed5986-01f5-447f-b216-7028dccd2fb6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.073875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a7bac71d6140e0a25b91dce0fc8bae', 'request_id': 'req-c2ed5986-01f5-447f-b216-7028dccd2fb6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.098780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] The token cache is being invalidate because project 64a7bac71d6140e0a25b91dce0fc8bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:36.099721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.101802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c2ed5986-01f5-447f-b216-7028dccd2fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.104036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 915/1835] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:35 2021] DELETE /identity/v3/projects/64a7bac71d6140e0a25b91dce0fc8bae => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:36.109569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af381dc-21f5-47f9-877b-22f5e756767c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.112101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af381dc-21f5-47f9-877b-22f5e756767c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.112482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af381dc-21f5-47f9-877b-22f5e756767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.177511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7cd10-68ec-430c-b519-f637dda28d85 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.183839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.185043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.185522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.185979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] PATH_INFO: `/v3/users/455e6ffd652e4784a7afa081aacd9fab` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.187762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=455e6ffd652e4784a7afa081aacd9fab)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.190289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.202991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7af381dc-21f5-47f9-877b-22f5e756767c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:36.204004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7af381dc-21f5-47f9-877b-22f5e756767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:36.239370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 916/1836] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:36.246597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572049-1c26-41c4-ba74-6c916700b8d4 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.247214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572049-1c26-41c4-ba74-6c916700b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.247214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4572049-1c26-41c4-ba74-6c916700b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.267247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455e6ffd652e4784a7afa081aacd9fab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.282560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f4572049-1c26-41c4-ba74-6c916700b8d4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:36.283965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f4572049-1c26-41c4-ba74-6c916700b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:36.293680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455e6ffd652e4784a7afa081aacd9fab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.311955 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455e6ffd652e4784a7afa081aacd9fab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.313359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455e6ffd652e4784a7afa081aacd9fab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.325048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 917/1837] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:36.330110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4572049-1c26-41c4-ba74-6c916700b8d4 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.347360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4572049-1c26-41c4-ba74-6c916700b8d4 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.352010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e73443aa-2357-45fb-b478-8aca51d325eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455e6ffd652e4784a7afa081aacd9fab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.363979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 921/1838] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:36 2021] DELETE /identity/v3/users/455e6ffd652e4784a7afa081aacd9fab => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:36.365519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.366192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.368563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.368791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.369669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.371315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.371315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.371525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:36.371711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.373286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.404687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 918/1839] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:36.405662 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.407321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:36.408332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:36.411632 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:36.439862 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d21d6-c42a-4a1a-a434-af17c3be7507 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.574787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 922/1840] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:36.579244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.579927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.580214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.580493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.581205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.584104 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.596510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.604220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:36.629434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 919/1841] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:36 2021] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:36.635002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.724547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205113ab-c0da-42e1-8bce-2945d0c3a366 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.788103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5630657-bca8-4925-96df-3cb4edca32c0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.789405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.790719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.791050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.791400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.803670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.805551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.819016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.819473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 923/1842] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:36.820534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.821117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.821750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.823011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.824979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.855796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 920/1843] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:36 2021] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:36.860111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.867724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.869955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:36.872492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee588f-9b50-40aa-ab26-650d87ca344a service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.878746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.879446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.879739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.880055 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.881560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.883183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.889664 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4266d1-e634-4d8c-8570-60ad1fb9520f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.897157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.898489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.898972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.899476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] PATH_INFO: `/v3/projects/b9633ac9a562417ba4f0bbd496f591c9` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.901310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9633ac9a562417ba4f0bbd496f591c9)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.904037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.921142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 924/1844] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:36 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:36.922848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.944552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb30356-eb28-46a1-b1d7-c02961b3a69c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:36.949685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:36.950367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:36.950670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:36.951486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:36.952299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:36.954203 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:36.966263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9633ac9a562417ba4f0bbd496f591c9', 'request_id': 'req-ee33e572-33b4-4e28-9aea-875790b281b0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.976483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 925/1845] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:36 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:36.980377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9633ac9a562417ba4f0bbd496f591c9', 'request_id': 'req-ee33e572-33b4-4e28-9aea-875790b281b0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.981298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:36.990726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9633ac9a562417ba4f0bbd496f591c9', 'request_id': 'req-ee33e572-33b4-4e28-9aea-875790b281b0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:36.994675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324937a-35f7-4a42-96fa-105b96571c6c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.007342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] The token cache is being invalidate because project b9633ac9a562417ba4f0bbd496f591c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:37.007717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:37.008619 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ee33e572-33b4-4e28-9aea-875790b281b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:37.015666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 921/1846] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:36 2021] DELETE /identity/v3/projects/b9633ac9a562417ba4f0bbd496f591c9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:37.017411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e9a7e-13c4-4c8b-99ae-e7f965f7b0f1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.017723 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e9a7e-13c4-4c8b-99ae-e7f965f7b0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.018006 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e9a7e-13c4-4c8b-99ae-e7f965f7b0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.039536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f13e9a7e-13c4-4c8b-99ae-e7f965f7b0f1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:37.044241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f13e9a7e-13c4-4c8b-99ae-e7f965f7b0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.070127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729dfc4-64f6-450e-92df-d331efff0e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.073484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dfc4-64f6-450e-92df-d331efff0e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.074879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dfc4-64f6-450e-92df-d331efff0e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.075139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729dfc4-64f6-450e-92df-d331efff0e4a admin admin] PATH_INFO: `/v3/projects/ab80dfef73194698b1e718b5cc83ea51/users/82f7256aed2047dcaa1ab32190d5c8f9/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.096222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729dfc4-64f6-450e-92df-d331efff0e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab80dfef73194698b1e718b5cc83ea51, user_id=82f7256aed2047dcaa1ab32190d5c8f9, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.099499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729dfc4-64f6-450e-92df-d331efff0e4a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.123637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 926/1847] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:36 2021] PUT /identity/v3/projects/ab80dfef73194698b1e718b5cc83ea51/users/82f7256aed2047dcaa1ab32190d5c8f9/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:37.135451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 922/1848] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:37.135635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92bf5c-081d-4a5a-be21-1471fe7edb20 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.136085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92bf5c-081d-4a5a-be21-1471fe7edb20 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.136431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92bf5c-081d-4a5a-be21-1471fe7edb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.143797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224b4d-2848-468a-a9ce-81b3ed5802a4 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.144655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224b4d-2848-468a-a9ce-81b3ed5802a4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.145189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1224b4d-2848-468a-a9ce-81b3ed5802a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.171533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1f92bf5c-081d-4a5a-be21-1471fe7edb20 None None] MFA Rules not processed for user `82f7256aed2047dcaa1ab32190d5c8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:37.172801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1f92bf5c-081d-4a5a-be21-1471fe7edb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.183728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a1224b4d-2848-468a-a9ce-81b3ed5802a4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:37.187894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a1224b4d-2848-468a-a9ce-81b3ed5802a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.251574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 927/1849] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:37.253092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f826-4339-4020-8d0d-c722a2869ecb None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.253504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f826-4339-4020-8d0d-c722a2869ecb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.253793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f826-4339-4020-8d0d-c722a2869ecb None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.255788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 928/1850] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:48:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:37.265353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6f826-4339-4020-8d0d-c722a2869ecb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.267287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-67e6f826-4339-4020-8d0d-c722a2869ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.299184 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 923/1851] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:37.304934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224b4d-2848-468a-a9ce-81b3ed5802a4 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.327183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1224b4d-2848-468a-a9ce-81b3ed5802a4 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.341690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.343296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.343806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.344295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.345043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:37.345355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.347149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.371077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 924/1852] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:37.378274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.395170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6f826-4339-4020-8d0d-c722a2869ecb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.400253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865fb42-ab20-4fac-87b2-4f57e3634945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.401520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865fb42-ab20-4fac-87b2-4f57e3634945 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.402230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865fb42-ab20-4fac-87b2-4f57e3634945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.402655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865fb42-ab20-4fac-87b2-4f57e3634945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.403472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee066643-b161-4d31-8d75-72558e700d72 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.414964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865fb42-ab20-4fac-87b2-4f57e3634945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.416924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.417462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865fb42-ab20-4fac-87b2-4f57e3634945 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.417584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.417846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.418085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.418800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.420706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.429274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 929/1853] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:37 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:37.430742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd054-a00e-4a52-9bfc-4d925e825c21 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.431041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd054-a00e-4a52-9bfc-4d925e825c21 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.431327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfd054-a00e-4a52-9bfc-4d925e825c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.452193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c5bfd054-a00e-4a52-9bfc-4d925e825c21 None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:37.458036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c5bfd054-a00e-4a52-9bfc-4d925e825c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.472552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 925/1854] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:37.473387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.475949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.571646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 930/1855] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:37.572585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd054-a00e-4a52-9bfc-4d925e825c21 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.583930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ab330-a19e-4b45-bf2e-f32b08909828 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.591919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.593871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.594361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.595007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] PATH_INFO: `/v3/users/82f7256aed2047dcaa1ab32190d5c8f9` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.596023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfd054-a00e-4a52-9bfc-4d925e825c21 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.596845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f7256aed2047dcaa1ab32190d5c8f9)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.600084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.601613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ed08a-6656-4bae-baf7-519b6e749069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.602578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed08a-6656-4bae-baf7-519b6e749069 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.602936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed08a-6656-4bae-baf7-519b6e749069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.603296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ed08a-6656-4bae-baf7-519b6e749069 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.604445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ed08a-6656-4bae-baf7-519b6e749069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.606797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ed08a-6656-4bae-baf7-519b6e749069 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.640102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 931/1856] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/users => generated 277 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:37.641646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db53a-22b4-41f6-8601-c1128e4f6af2 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.642012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db53a-22b4-41f6-8601-c1128e4f6af2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.642380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db53a-22b4-41f6-8601-c1128e4f6af2 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.644272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 932/1857] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:48:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:48:37.645094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db53a-22b4-41f6-8601-c1128e4f6af2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.659727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db53a-22b4-41f6-8601-c1128e4f6af2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.665924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb271dd-2d85-4fce-bdf4-a9e84461e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.666595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb271dd-2d85-4fce-bdf4-a9e84461e03f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.666883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb271dd-2d85-4fce-bdf4-a9e84461e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.667168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb271dd-2d85-4fce-bdf4-a9e84461e03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.667908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb271dd-2d85-4fce-bdf4-a9e84461e03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.668927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f7256aed2047dcaa1ab32190d5c8f9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:37.669541 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb271dd-2d85-4fce-bdf4-a9e84461e03f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.670131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f7256aed2047dcaa1ab32190d5c8f9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:37.680265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f7256aed2047dcaa1ab32190d5c8f9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:37.680757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 933/1858] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:37 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:37.682265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913908-eaea-451a-9006-8f5be830171d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.682485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913908-eaea-451a-9006-8f5be830171d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.682783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e913908-eaea-451a-9006-8f5be830171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.689860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f7256aed2047dcaa1ab32190d5c8f9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:37.690763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f7256aed2047dcaa1ab32190d5c8f9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:37.701578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7e913908-eaea-451a-9006-8f5be830171d None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:37.702797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7e913908-eaea-451a-9006-8f5be830171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.714414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 926/1859] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:37 2021] DELETE /identity/v3/users/82f7256aed2047dcaa1ab32190d5c8f9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:37.719590 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.722122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.816182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcaa45-fdae-4ed6-827d-88fa91d38d8d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.820292 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 934/1860] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:37.822758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.823914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.824589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.825136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.826737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.829878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.830024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.830176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.830460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.841759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 927/1861] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:37 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:37.846147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.856878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918821-1fe0-450f-9872-5a91bfe7e593 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:37.866169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:37.866362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:37.867491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:37.867722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.868109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:37.869039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] PATH_INFO: `/v3/projects/0702e839e6394bf59278489eaede4933/users/7b312fe0e6b64a5eacbb17cc545ce8ab/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:37.876248 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 935/1862] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:37.877222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.878568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.891367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0702e839e6394bf59278489eaede4933, user_id=7b312fe0e6b64a5eacbb17cc545ce8ab, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:37.897407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:37.920732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 928/1863] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:37 2021] PUT /identity/v3/projects/0702e839e6394bf59278489eaede4933/users/7b312fe0e6b64a5eacbb17cc545ce8ab/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:37.921936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:37.923840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:37.986639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d9c0d-fb2e-4cbd-9314-a60639da0bce None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.029418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58552-e97c-4674-90b6-5da68488b4b9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.034526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.035485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.035862 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.036785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.080032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73eba8-46d3-4411-a4db-4d057097f707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.081009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73eba8-46d3-4411-a4db-4d057097f707 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.081553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73eba8-46d3-4411-a4db-4d057097f707 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.082201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73eba8-46d3-4411-a4db-4d057097f707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.085976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bb73eba8-46d3-4411-a4db-4d057097f707 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.104815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73eba8-46d3-4411-a4db-4d057097f707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.107539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73eba8-46d3-4411-a4db-4d057097f707 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.128250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.129748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.140357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 929/1864] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:38.141102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.141748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 936/1865] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:37 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:38.142447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.143757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434a9b-b057-4072-aa4b-d60af8b5a2af None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.144164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434a9b-b057-4072-aa4b-d60af8b5a2af None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.144576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434a9b-b057-4072-aa4b-d60af8b5a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.158185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd832b1-ce58-49fa-9561-4fbb4a9d0ec2 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.166788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.167788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.169031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.170497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] PATH_INFO: `/v3/projects/c46327bf68ab4b56ae3b24828f4030f6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.173455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46327bf68ab4b56ae3b24828f4030f6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.178167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.210734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9e434a9b-b057-4072-aa4b-d60af8b5a2af None None] MFA Rules not processed for user `7b312fe0e6b64a5eacbb17cc545ce8ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:38.212027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9e434a9b-b057-4072-aa4b-d60af8b5a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.264549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46327bf68ab4b56ae3b24828f4030f6', 'request_id': 'req-d67172b3-8279-4d4b-aeb5-28b9065f02d6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.292091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46327bf68ab4b56ae3b24828f4030f6', 'request_id': 'req-d67172b3-8279-4d4b-aeb5-28b9065f02d6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.298958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46327bf68ab4b56ae3b24828f4030f6', 'request_id': 'req-d67172b3-8279-4d4b-aeb5-28b9065f02d6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.301579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 937/1866] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:38 2021] POST /identity/v3/auth/tokens => generated 3373 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:38.305876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434a9b-b057-4072-aa4b-d60af8b5a2af None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.309620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] The token cache is being invalidate because project c46327bf68ab4b56ae3b24828f4030f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:38.310058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.311127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.312527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 930/1867] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:38 2021] DELETE /identity/v3/projects/c46327bf68ab4b56ae3b24828f4030f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:38.313337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.315019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.323345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434a9b-b057-4072-aa4b-d60af8b5a2af None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.390934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67172b3-8279-4d4b-aeb5-28b9065f02d6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.396354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.397019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.397302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.397621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.398366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.400282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.408745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.409445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.410109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.410109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.413280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.428098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.428759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 931/1868] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:38 2021] POST /identity/v3/projects => generated 357 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:38.430076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.432224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.434070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.443610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 938/1869] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:38.446367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.469156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd89213-06b0-4b91-b6ad-09b86c18fe70 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.511550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f20f-9d00-46d3-a705-e542cbcb98bd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.516661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.517863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.518559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.518559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] PATH_INFO: `/v3/users/77b72f004b6e4a3f9d2b839888bbc680` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.519724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b72f004b6e4a3f9d2b839888bbc680)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.522267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.546683 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.547789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.548181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.548534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.549363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.551775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.575553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 939/1870] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:38 2021] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:38.579424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.590280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b72f004b6e4a3f9d2b839888bbc680'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.591406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b72f004b6e4a3f9d2b839888bbc680'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.593465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895a11d-7805-48b9-8571-664b8e462a56 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.601266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.602418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.602821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.603140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.603244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b72f004b6e4a3f9d2b839888bbc680'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.604380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.607607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.622601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 940/1871] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:38 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:38.623049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b72f004b6e4a3f9d2b839888bbc680'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.623460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.624326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b72f004b6e4a3f9d2b839888bbc680'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.630444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.645969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 932/1872] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:38 2021] DELETE /identity/v3/users/77b72f004b6e4a3f9d2b839888bbc680 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:38.647181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.652898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089c0d8-04d3-4770-b64b-140aec1a649a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.663385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.733026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.736876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.737454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.737778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] PATH_INFO: `/v3/users/f87c59dedb34461a97059bbbee67914e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.739225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87c59dedb34461a97059bbbee67914e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.741943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.759327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242d50d-0495-4418-80ba-365c3412cf4d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.764855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.765819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.766107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.766379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] PATH_INFO: `/v3/projects/ab80dfef73194698b1e718b5cc83ea51` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.767850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab80dfef73194698b1e718b5cc83ea51)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:38.769954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:38.806524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87c59dedb34461a97059bbbee67914e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.816299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87c59dedb34461a97059bbbee67914e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.823828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab80dfef73194698b1e718b5cc83ea51', 'request_id': 'req-eb29536b-c8e0-4271-a80e-cfba1d262286'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.826516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87c59dedb34461a97059bbbee67914e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.827475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87c59dedb34461a97059bbbee67914e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.835741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab80dfef73194698b1e718b5cc83ea51', 'request_id': 'req-eb29536b-c8e0-4271-a80e-cfba1d262286'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.843684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87c59dedb34461a97059bbbee67914e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.845599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab80dfef73194698b1e718b5cc83ea51', 'request_id': 'req-eb29536b-c8e0-4271-a80e-cfba1d262286'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.854744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 941/1873] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:38 2021] DELETE /identity/v3/users/f87c59dedb34461a97059bbbee67914e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:38.855830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:38.862990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.866731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] The token cache is being invalidate because project ab80dfef73194698b1e718b5cc83ea51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:38.867042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.868234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-eb29536b-c8e0-4271-a80e-cfba1d262286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:38.870819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 933/1874] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:38 2021] DELETE /identity/v3/projects/ab80dfef73194698b1e718b5cc83ea51 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:38.872335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc746-0f10-4ac2-8eb1-5cb6b22eba16 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.872634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc746-0f10-4ac2-8eb1-5cb6b22eba16 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.872920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc746-0f10-4ac2-8eb1-5cb6b22eba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.900438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8b5cc746-0f10-4ac2-8eb1-5cb6b22eba16 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:38.902571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8b5cc746-0f10-4ac2-8eb1-5cb6b22eba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:38.956302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61666c7d-4635-423e-bcd8-fb9e5689aeee admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:38.963283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:38.964237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:38.964526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:38.964810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] PATH_INFO: `/v3/projects/299df45394114a0ba70529a0f10a8383/users/55797b1b4657485594de7a80ef9743a2/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:38.996072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 934/1875] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:38.997748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299df45394114a0ba70529a0f10a8383, user_id=55797b1b4657485594de7a80ef9743a2, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.000821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.003498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.003808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.004098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.030380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:39.030768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 942/1876] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:38 2021] PUT /identity/v3/projects/299df45394114a0ba70529a0f10a8383/users/55797b1b4657485594de7a80ef9743a2/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:39.031727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.032524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.039143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.105107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 935/1877] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:39.106030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.107733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.125951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e81ca-8308-4d2e-93f1-3231a818b13d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.134039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6c40a0-de64-4ee6-9fc6-ec35ff3c183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.134896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c40a0-de64-4ee6-9fc6-ec35ff3c183c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.135219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c40a0-de64-4ee6-9fc6-ec35ff3c183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.135590 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6c40a0-de64-4ee6-9fc6-ec35ff3c183c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.136494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c40a0-de64-4ee6-9fc6-ec35ff3c183c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.136858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c87a50-0e56-4624-a01d-a8df67cae601 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.138333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6c40a0-de64-4ee6-9fc6-ec35ff3c183c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.141361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.142344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.142805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.143255 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.154761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 936/1878] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:39 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:39.155326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.156315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.156698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.157043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.158841 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.171975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 943/1879] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:39.173338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.191727 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc75122-7b61-4ad6-8b65-e22003ecec7f service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.200286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.201478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.201964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.202459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] PATH_INFO: `/v3/projects/299df45394114a0ba70529a0f10a8383/users/55797b1b4657485594de7a80ef9743a2/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.204965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299df45394114a0ba70529a0f10a8383, user_id=55797b1b4657485594de7a80ef9743a2, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.212718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:39.216848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.218271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.243585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 937/1881] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:39.244046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.248895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 944/1881] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:39 2021] PUT /identity/v3/projects/299df45394114a0ba70529a0f10a8383/users/55797b1b4657485594de7a80ef9743a2/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:39.249933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.250048 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.272073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fac7b7-d11c-492a-b91a-a7d5a43de924 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.328017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcde32a-2a42-4821-8ec5-2c13e81b5f09 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.334232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5412dc-d3d1-4928-83c3-e4b8a4ca434f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.336086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5412dc-d3d1-4928-83c3-e4b8a4ca434f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.336567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5412dc-d3d1-4928-83c3-e4b8a4ca434f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.337085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5412dc-d3d1-4928-83c3-e4b8a4ca434f admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.338127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5412dc-d3d1-4928-83c3-e4b8a4ca434f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:39.338590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5412dc-d3d1-4928-83c3-e4b8a4ca434f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.341950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5412dc-d3d1-4928-83c3-e4b8a4ca434f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.358300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 945/1882] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:39.360773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb37e3-0314-435c-92fb-a6c8a72eef00 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.361285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb37e3-0314-435c-92fb-a6c8a72eef00 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.361829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb37e3-0314-435c-92fb-a6c8a72eef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.370606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.371640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.371931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.372209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] PATH_INFO: `/v3/projects/702e9d1f86bd4881a2fc8d1c1fb7ef4e` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.374257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702e9d1f86bd4881a2fc8d1c1fb7ef4e)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.376401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.400628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-06eb37e3-0314-435c-92fb-a6c8a72eef00 None None] MFA Rules not processed for user `55797b1b4657485594de7a80ef9743a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:39.403132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-06eb37e3-0314-435c-92fb-a6c8a72eef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.459796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702e9d1f86bd4881a2fc8d1c1fb7ef4e', 'request_id': 'req-264384fe-5054-4a7d-91e0-1d933b6e7ab4'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.470296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702e9d1f86bd4881a2fc8d1c1fb7ef4e', 'request_id': 'req-264384fe-5054-4a7d-91e0-1d933b6e7ab4'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.480827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702e9d1f86bd4881a2fc8d1c1fb7ef4e', 'request_id': 'req-264384fe-5054-4a7d-91e0-1d933b6e7ab4'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.493522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] The token cache is being invalidate because project 702e9d1f86bd4881a2fc8d1c1fb7ef4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:39.494232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.495302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.501598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 938/1883] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:39 2021] DELETE /identity/v3/projects/702e9d1f86bd4881a2fc8d1c1fb7ef4e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:39.502583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.505610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.521792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 946/1884] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:39 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:39.523453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.523659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.523927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.543885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:39.545127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.602377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264384fe-5054-4a7d-91e0-1d933b6e7ab4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.609131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.610408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.610703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.611208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.611891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.614387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.624083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 947/1885] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:39.625452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.627045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.646403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 939/1886] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:39 2021] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:39.647743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.650589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100eed0-dfbd-472d-88f9-a11ecbfff872 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.651545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.710705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02d013-a7c0-4e0a-9787-1aae4abd52e8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.714417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a95dbd-241f-4ede-8d91-5e80d662ba60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.715070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a95dbd-241f-4ede-8d91-5e80d662ba60 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.715351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a95dbd-241f-4ede-8d91-5e80d662ba60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.715643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a95dbd-241f-4ede-8d91-5e80d662ba60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.717692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-82a95dbd-241f-4ede-8d91-5e80d662ba60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.721032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.721946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.722366 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.722733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] PATH_INFO: `/v3/users/d36670a1340d40489e5cdc2591cc21a4` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.724640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36670a1340d40489e5cdc2591cc21a4)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.726619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.785470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36670a1340d40489e5cdc2591cc21a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.794505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36670a1340d40489e5cdc2591cc21a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.795579 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a95dbd-241f-4ede-8d91-5e80d662ba60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.797194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a95dbd-241f-4ede-8d91-5e80d662ba60 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.801712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36670a1340d40489e5cdc2591cc21a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.802437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36670a1340d40489e5cdc2591cc21a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.812030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 940/1887] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:39 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:39.813454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb09c2-2477-431d-a23c-db72670175a9 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.813694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb09c2-2477-431d-a23c-db72670175a9 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.813979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb09c2-2477-431d-a23c-db72670175a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.824712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36670a1340d40489e5cdc2591cc21a4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:39.833741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 948/1888] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:39 2021] DELETE /identity/v3/users/d36670a1340d40489e5cdc2591cc21a4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:39.834554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.836003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.837789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-04bb09c2-2477-431d-a23c-db72670175a9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:39.839223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-04bb09c2-2477-431d-a23c-db72670175a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.920451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 941/1889] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:39.924918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.925216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.925572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.951819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:39.953036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:39.957120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368e9af-aedd-491b-b4ca-30bc485f1690 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:39.967892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:39.968607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:39.969354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:39.969659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:39.971802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:39.974317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:39.975833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 942/1890] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:39.976423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:39.978179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.005813 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 949/1891] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:39 2021] POST /identity/v3/users => generated 281 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:40.006883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.018019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96ccc-934e-4282-9a84-3d73dbf09f1b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.025239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.025239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.025239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.025239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.027911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:40.027911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.027911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.041329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 950/1892] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:40.043957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.046779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.055622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332cff8-e284-40e3-b32f-b0cfe9293933 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.059206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.059568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe9be4-feb8-46d4-b30d-9693285c06df admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.059886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.060292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.060621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.062378 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.064236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.065081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.065454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.065743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] PATH_INFO: `/v3/projects/ef1306d937bb4dcbb776fce2852dfa47` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.066941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1306d937bb4dcbb776fce2852dfa47)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.069360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.115024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1306d937bb4dcbb776fce2852dfa47', 'request_id': 'req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.121558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.122995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.124729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1306d937bb4dcbb776fce2852dfa47', 'request_id': 'req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.132927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 943/1893] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:39 2021] GET /identity/v3/auth/tokens => generated 3373 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:40.133086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1306d937bb4dcbb776fce2852dfa47', 'request_id': 'req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.133718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.135101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.144093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] The token cache is being invalidate because project ef1306d937bb4dcbb776fce2852dfa47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:40.144389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.145420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.150615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 951/1894] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:40 2021] DELETE /identity/v3/projects/ef1306d937bb4dcbb776fce2852dfa47 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:40.150615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.150615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.208859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4222-f220-403c-9fcb-cacb07fa808c service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.224981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd8f60-bcf0-4b5c-94e5-cb75e298f028 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.230452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.231134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.231428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.231713 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.232711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.234446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.246357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 952/1895] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:40.247285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.249286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.265457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d5ea-5c89-48a6-9e53-947a4f6eb78c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.271604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.272920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.273535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.273912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.275005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.277064 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.281676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.282078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.282362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.282638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.284434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.311057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 953/1896] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:40 2021] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:40.311233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.311326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.311488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.313139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.324840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 944/1897] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:40.325669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.342224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18658d-6955-41a9-adb2-77d31a987eea service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.393833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f225ee-6574-4af8-8d8c-9795f0348750 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.401143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.402537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.402989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.402989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.403287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.403467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] PATH_INFO: `/v3/users/7a960783ef6d4483a4aedebd5a3e22ef` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.403616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.403936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.404808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.405472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a960783ef6d4483a4aedebd5a3e22ef)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.406464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.408526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.420794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 945/1898] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:40.420794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.431037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181b61e-be77-47d6-a4ce-0d1637e3e8cd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.435814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.436562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.436920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.437273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.438255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.440178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.460508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 946/1899] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:40 2021] POST /identity/v3/users => generated 296 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:40.461411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.469240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a960783ef6d4483a4aedebd5a3e22ef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.473337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8af0e-119d-4233-a1db-452f1e1cd03c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.479496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781d1c2-57c7-4c35-a678-e1145ed19de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.479874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a960783ef6d4483a4aedebd5a3e22ef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.480103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d1c2-57c7-4c35-a678-e1145ed19de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.480400 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d1c2-57c7-4c35-a678-e1145ed19de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.480681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781d1c2-57c7-4c35-a678-e1145ed19de0 admin admin] PATH_INFO: `/v3/projects/fcafa5ba32fc48d0a397f68b9c05e498/users/4bc662218b924f1db01f8945cc798c88/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.488906 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a960783ef6d4483a4aedebd5a3e22ef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.490702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a960783ef6d4483a4aedebd5a3e22ef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.495994 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781d1c2-57c7-4c35-a678-e1145ed19de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcafa5ba32fc48d0a397f68b9c05e498, user_id=4bc662218b924f1db01f8945cc798c88, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.498724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781d1c2-57c7-4c35-a678-e1145ed19de0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.506232 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a960783ef6d4483a4aedebd5a3e22ef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:40.517939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 954/1900] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:40 2021] DELETE /identity/v3/users/7a960783ef6d4483a4aedebd5a3e22ef => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:40.518670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.520198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.534348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 947/1901] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:40 2021] PUT /identity/v3/projects/fcafa5ba32fc48d0a397f68b9c05e498/users/4bc662218b924f1db01f8945cc798c88/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:40.548540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.549642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.550214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.584964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] MFA Rules not processed for user `4bc662218b924f1db01f8945cc798c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:40.587473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.626748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4f0a8-7fde-412a-83af-49a348320337 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.633229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.634027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.634472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.634817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.635742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.638039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.652863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 955/1902] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:40.654192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.670610 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 948/1903] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:40 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:40.676573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0f1bd-d886-459d-bfae-6a5899670a2d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.690421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.691026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.691512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.691873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.694356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.698608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.705846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.707452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.722393 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 956/1904] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:40.724298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.737623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbc28b-0ef0-46cc-aa8f-1b188ad35479 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.759315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.761917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.763261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.765624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] PATH_INFO: `/v3/projects/1c8596cda33f4cf3a32619a7c1cd20fc/users/f17e6e4e22844595af5f19b414358056/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.784864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd91b45-59b8-4114-9ee4-4f05664ef868 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.786790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8596cda33f4cf3a32619a7c1cd20fc, user_id=f17e6e4e22844595af5f19b414358056, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.789657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182a8f4-d13f-4216-8145-bdaa90c05f0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.789941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.790766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a8f4-d13f-4216-8145-bdaa90c05f0b service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.791338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a8f4-d13f-4216-8145-bdaa90c05f0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.792003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182a8f4-d13f-4216-8145-bdaa90c05f0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.823046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a8f4-d13f-4216-8145-bdaa90c05f0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.829001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182a8f4-d13f-4216-8145-bdaa90c05f0b service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.840420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 957/1905] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:40 2021] PUT /identity/v3/projects/1c8596cda33f4cf3a32619a7c1cd20fc/users/f17e6e4e22844595af5f19b414358056/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:40.843253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.846207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.851374 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 949/1906] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:40 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:40.852867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.853167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.853490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.891768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] MFA Rules not processed for user `f17e6e4e22844595af5f19b414358056`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:40.894580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:40.960270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ae6c5-0f1e-4acd-b288-8497dca5cfb5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:40.966949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:40.968008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:40.968402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:40.968907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] PATH_INFO: `/v3/projects/fc1a8e90132b42a99de133521fc0ffe1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:40.970577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1a8e90132b42a99de133521fc0ffe1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:40.972831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:40.979938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 950/1907] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:40 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:40.980770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:40.982090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.005718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58670618-fc02-4b4c-b24b-4c9d3ac19509 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.011259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.012301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.012583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.012922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] PATH_INFO: `/v3/users/4bc662218b924f1db01f8945cc798c88` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.014468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc662218b924f1db01f8945cc798c88)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.016377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.030553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1a8e90132b42a99de133521fc0ffe1', 'request_id': 'req-aa30192c-f6ce-4e57-a932-301d18ffe372'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.038806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1a8e90132b42a99de133521fc0ffe1', 'request_id': 'req-aa30192c-f6ce-4e57-a932-301d18ffe372'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.047622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1a8e90132b42a99de133521fc0ffe1', 'request_id': 'req-aa30192c-f6ce-4e57-a932-301d18ffe372'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.059285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] The token cache is being invalidate because project fc1a8e90132b42a99de133521fc0ffe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:41.059578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.060298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.062109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 958/1908] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:40 2021] DELETE /identity/v3/projects/fc1a8e90132b42a99de133521fc0ffe1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:41.062807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.064108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.064386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc662218b924f1db01f8945cc798c88'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.065304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc662218b924f1db01f8945cc798c88'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.072583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc662218b924f1db01f8945cc798c88'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.079226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc662218b924f1db01f8945cc798c88'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.079926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc662218b924f1db01f8945cc798c88'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.096745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 951/1909] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:40 2021] DELETE /identity/v3/users/4bc662218b924f1db01f8945cc798c88 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:41.097623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.099525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.129013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30192c-f6ce-4e57-a932-301d18ffe372 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.160931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b0a9-6abf-4dd6-bd01-b33b13d2d243 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.166222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.167013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.167307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.167588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.168297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.170248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.186380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.187624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.187917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.188202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] PATH_INFO: `/v3/projects/1065d4d05a044883b642232fabbb3aab` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.189509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1065d4d05a044883b642232fabbb3aab)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.191855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.202704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 952/1910] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:41 2021] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:41.202704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.204685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.245058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1065d4d05a044883b642232fabbb3aab', 'request_id': 'req-b106d767-12cb-443d-adb3-a9d9d8c0b809'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.253644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1065d4d05a044883b642232fabbb3aab', 'request_id': 'req-b106d767-12cb-443d-adb3-a9d9d8c0b809'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.260989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1065d4d05a044883b642232fabbb3aab', 'request_id': 'req-b106d767-12cb-443d-adb3-a9d9d8c0b809'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.272349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2729-c5e9-4f3b-8e2d-df092ceb276d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.272822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] The token cache is being invalidate because project 1065d4d05a044883b642232fabbb3aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:41.273183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.273937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b106d767-12cb-443d-adb3-a9d9d8c0b809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.283808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 959/1911] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:41 2021] DELETE /identity/v3/projects/1065d4d05a044883b642232fabbb3aab => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:41.283808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.283808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.283808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.303345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:41.304838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.373186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.375076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.375076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.375381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] PATH_INFO: `/v3/users/5ccf8d591bca4addb898d69ccaaa8148` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.376996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccf8d591bca4addb898d69ccaaa8148)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.379537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 960/1912] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:41.380422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.382217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.383943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.416983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dcdc5-c858-45ae-a1c3-52aa9d6451a0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.431340 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3c515-1bc2-4555-88d3-62ee09f65d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.432106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c515-1bc2-4555-88d3-62ee09f65d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.432398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c515-1bc2-4555-88d3-62ee09f65d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.432687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3c515-1bc2-4555-88d3-62ee09f65d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.433669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3c515-1bc2-4555-88d3-62ee09f65d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.435615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3c515-1bc2-4555-88d3-62ee09f65d00 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.465397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccf8d591bca4addb898d69ccaaa8148'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.466336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccf8d591bca4addb898d69ccaaa8148'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.476204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 961/1913] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:41 2021] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:41.483608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.484187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.484940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.485986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccf8d591bca4addb898d69ccaaa8148'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.495975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccf8d591bca4addb898d69ccaaa8148'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.496879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccf8d591bca4addb898d69ccaaa8148'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:41.515569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:41.516713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 953/1914] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:41 2021] DELETE /identity/v3/users/5ccf8d591bca4addb898d69ccaaa8148 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:41.517928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.519974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.526836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.622104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 962/1915] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:41.622104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.631830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.645444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9f070-0391-443b-99a5-2ba88d8acd2b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.650265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c097c2-b9f7-4620-8348-ffa0ef72f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.651031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c097c2-b9f7-4620-8348-ffa0ef72f02a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.651299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c097c2-b9f7-4620-8348-ffa0ef72f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.651642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c097c2-b9f7-4620-8348-ffa0ef72f02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.652409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c097c2-b9f7-4620-8348-ffa0ef72f02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.653747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afb8e2-62ed-4183-89ec-34bc627365ba admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.654124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c097c2-b9f7-4620-8348-ffa0ef72f02a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.659803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.660647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.660973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.661884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.664176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.669233 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 963/1916] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:41 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:41.671078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95687-936d-4d34-b2be-9a9b0bdc8ea2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.671618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95687-936d-4d34-b2be-9a9b0bdc8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.672686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95687-936d-4d34-b2be-9a9b0bdc8ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.682642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.684055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.695583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e0d95687-936d-4d34-b2be-9a9b0bdc8ea2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:41.695801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 954/1917] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:41.696603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.697175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e0d95687-936d-4d34-b2be-9a9b0bdc8ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:41.709154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 964/1918] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:41.710322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95687-936d-4d34-b2be-9a9b0bdc8ea2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.714290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e8cc1-926f-4145-b883-24336a6c7fc6 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.719639 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.720548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.720837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.721125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] PATH_INFO: `/v3/projects/d5d75fdcc31c42daa7e35c4153e3c0f7/users/349a9ee681f24251a06e30672e80c4c2/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.721259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95687-936d-4d34-b2be-9a9b0bdc8ea2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.727877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.728698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.729171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.729794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.730553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:41.730933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.732687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.752700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d75fdcc31c42daa7e35c4153e3c0f7, user_id=349a9ee681f24251a06e30672e80c4c2, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.755073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 965/1919] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:41.755489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.759404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.773751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67a1e5-1f77-4c7a-af35-41eae65cfc65 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.782420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.783260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.783619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.784062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.784714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.788802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.799475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 955/1920] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:41 2021] PUT /identity/v3/projects/d5d75fdcc31c42daa7e35c4153e3c0f7/users/349a9ee681f24251a06e30672e80c4c2/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:41.805005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.836804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 966/1921] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:41 2021] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:41.840200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.942490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f601de6-20a2-4870-a7e4-84540ff848ee admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.946299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a6f3c-6626-4483-968d-22ee169d4f67 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.948118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.948800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.949089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.949404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.950156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.951762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.952286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.953135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.953597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.953977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.954914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.957019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:41.966681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 956/1922] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:41 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:41.967612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.978559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab0fe-1e08-4470-a893-7cd44eecb7cf admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:41.985408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950dcc1a-a043-43e7-939b-7bc349357ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:41.985949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 967/1923] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:41 2021] POST /identity/v3/users => generated 284 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:41.986391 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dcc1a-a043-43e7-939b-7bc349357ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:41.986689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dcc1a-a043-43e7-939b-7bc349357ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:41.986993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950dcc1a-a043-43e7-939b-7bc349357ca7 admin admin] PATH_INFO: `/v3/projects/d5d75fdcc31c42daa7e35c4153e3c0f7/users/349a9ee681f24251a06e30672e80c4c2/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:41.989054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dcc1a-a043-43e7-939b-7bc349357ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d75fdcc31c42daa7e35c4153e3c0f7, user_id=349a9ee681f24251a06e30672e80c4c2, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:41.990030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:41.992559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950dcc1a-a043-43e7-939b-7bc349357ca7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.009640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3a803-4401-4106-9206-c75f421cf0d5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.020237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 957/1924] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:41 2021] PUT /identity/v3/projects/d5d75fdcc31c42daa7e35c4153e3c0f7/users/349a9ee681f24251a06e30672e80c4c2/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:42.031870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.032168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.032455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.063241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] MFA Rules not processed for user `349a9ee681f24251a06e30672e80c4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:42.064484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.147982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.149429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.149429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.159455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.165753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.170386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.200452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 968/1925] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:41 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:42.201892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.207116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.213589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 958/1926] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/auth/tokens => generated 3478 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:42.214958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.216709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.228922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bfbed-38c7-426a-8b9b-d4ee64563876 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.234097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c09953-9b08-4eeb-9384-ab4fd1bf2881 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.240114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.241125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.241464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.241839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] PATH_INFO: `/v3/projects/fcafa5ba32fc48d0a397f68b9c05e498` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.243161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcafa5ba32fc48d0a397f68b9c05e498)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.245808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.250836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.253195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.255925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.256464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] PATH_INFO: `/v3/projects/ea6b10ef785e43e3b2a4d7646c1a312e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.258729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6b10ef785e43e3b2a4d7646c1a312e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.262864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.301008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcafa5ba32fc48d0a397f68b9c05e498', 'request_id': 'req-90632a76-7264-441f-9371-5efda9d4d7a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.310023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcafa5ba32fc48d0a397f68b9c05e498', 'request_id': 'req-90632a76-7264-441f-9371-5efda9d4d7a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.314643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6b10ef785e43e3b2a4d7646c1a312e', 'request_id': 'req-3b210abc-4e7f-477e-a89d-3736868851ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.316569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcafa5ba32fc48d0a397f68b9c05e498', 'request_id': 'req-90632a76-7264-441f-9371-5efda9d4d7a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.322945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6b10ef785e43e3b2a4d7646c1a312e', 'request_id': 'req-3b210abc-4e7f-477e-a89d-3736868851ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.329872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6b10ef785e43e3b2a4d7646c1a312e', 'request_id': 'req-3b210abc-4e7f-477e-a89d-3736868851ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.330048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] The token cache is being invalidate because project fcafa5ba32fc48d0a397f68b9c05e498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:42.330327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.331181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.332826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 959/1927] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:42 2021] DELETE /identity/v3/projects/fcafa5ba32fc48d0a397f68b9c05e498 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:42.334200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.338778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.341704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] The token cache is being invalidate because project ea6b10ef785e43e3b2a4d7646c1a312e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:42.341997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.342660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:42.344202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 969/1928] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:42 2021] DELETE /identity/v3/projects/ea6b10ef785e43e3b2a4d7646c1a312e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:42.344962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.346300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.408703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b210abc-4e7f-477e-a89d-3736868851ff admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.410711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90632a76-7264-441f-9371-5efda9d4d7a2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.412749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a658bd-4811-43f9-8a41-704ad3aed0c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.413438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a658bd-4811-43f9-8a41-704ad3aed0c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.413734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a658bd-4811-43f9-8a41-704ad3aed0c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.414019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a658bd-4811-43f9-8a41-704ad3aed0c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.416054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-75a658bd-4811-43f9-8a41-704ad3aed0c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.467462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6a815-bd2e-4693-909e-6711984ea0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.468135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6a815-bd2e-4693-909e-6711984ea0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.468427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6a815-bd2e-4693-909e-6711984ea0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.468703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6a815-bd2e-4693-909e-6711984ea0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.469471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6a815-bd2e-4693-909e-6711984ea0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.471076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6a815-bd2e-4693-909e-6711984ea0b3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.480003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a658bd-4811-43f9-8a41-704ad3aed0c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.481414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 960/1929] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:42 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:42.481718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a658bd-4811-43f9-8a41-704ad3aed0c6 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.482504 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639205-f9c9-482d-80d2-df5e879294be None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.482793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639205-f9c9-482d-80d2-df5e879294be None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.483070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639205-f9c9-482d-80d2-df5e879294be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.491593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 970/1930] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:42 2021] GET /identity/v3/auth/tokens => generated 3478 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:42.493145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0dbc7-c427-45fd-b28f-9d94ae19e5a9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.493574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0dbc7-c427-45fd-b28f-9d94ae19e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.493932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0dbc7-c427-45fd-b28f-9d94ae19e5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.509288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-15639205-f9c9-482d-80d2-df5e879294be None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:42.513027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-15639205-f9c9-482d-80d2-df5e879294be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.523031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-34b0dbc7-c427-45fd-b28f-9d94ae19e5a9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:42.524731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-34b0dbc7-c427-45fd-b28f-9d94ae19e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.541681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 961/1931] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:42.541681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15639205-f9c9-482d-80d2-df5e879294be None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.541681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-15639205-f9c9-482d-80d2-df5e879294be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.544734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 971/1932] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:42.551835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b3199-3887-450e-a268-83d320524a19 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.551835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b3199-3887-450e-a268-83d320524a19 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.551835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b3199-3887-450e-a268-83d320524a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.574494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-222b3199-3887-450e-a268-83d320524a19 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:42.575719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-222b3199-3887-450e-a268-83d320524a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.579762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15639205-f9c9-482d-80d2-df5e879294be None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.588514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 972/1933] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:42.588676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.588789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184635-cdb4-4ffe-941d-5e1f948c1995 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.588789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184635-cdb4-4ffe-941d-5e1f948c1995 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.588919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.589003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184635-cdb4-4ffe-941d-5e1f948c1995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.589078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.589078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] PATH_INFO: `/v3/projects/b6edfc643ede4e04944ab90e751fd7f0/users/cf44cc21ba2448899c30684db54cbdff/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.610880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6edfc643ede4e04944ab90e751fd7f0, user_id=cf44cc21ba2448899c30684db54cbdff, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.611331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-79184635-cdb4-4ffe-941d-5e1f948c1995 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:42.612686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-79184635-cdb4-4ffe-941d-5e1f948c1995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.614165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.623415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 973/1934] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:42.624410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184635-cdb4-4ffe-941d-5e1f948c1995 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.635311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184635-cdb4-4ffe-941d-5e1f948c1995 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.648614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 962/1935] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:42 2021] PUT /identity/v3/projects/b6edfc643ede4e04944ab90e751fd7f0/users/cf44cc21ba2448899c30684db54cbdff/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:42.649249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.711271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83366a-ec80-41d8-be50-d53f0b9a81e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.712132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83366a-ec80-41d8-be50-d53f0b9a81e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.712491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83366a-ec80-41d8-be50-d53f0b9a81e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.712840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83366a-ec80-41d8-be50-d53f0b9a81e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.715009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4f83366a-ec80-41d8-be50-d53f0b9a81e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.746224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906cdee-cec7-4ef7-a89e-724023c68be2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.751186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.751851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.752137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.752415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.753208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:42.753539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.755314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.771760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 963/1936] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:42.775354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.785601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb5f6d-6444-4ac8-8848-b64cab4ffdba admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.792811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.793782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.794316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.794986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.797339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:42.797848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.799744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.804109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83366a-ec80-41d8-be50-d53f0b9a81e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.805585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83366a-ec80-41d8-be50-d53f0b9a81e6 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.817718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 974/1937] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:42 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:42.819950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 964/1938] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:42.820885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.821185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f64be-6655-4ac2-b3c6-b4f86b6cdf0f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.821707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f64be-6655-4ac2-b3c6-b4f86b6cdf0f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.822173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f64be-6655-4ac2-b3c6-b4f86b6cdf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.841673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e97e4-352a-4161-98ad-8902531dda15 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.848513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.849861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.850990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.851281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.852000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.854979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:42.858201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6c8f64be-6655-4ac2-b3c6-b4f86b6cdf0f None None] MFA Rules not processed for user `cf44cc21ba2448899c30684db54cbdff`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:42.859839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6c8f64be-6655-4ac2-b3c6-b4f86b6cdf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:42.889961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 965/1939] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:42.891315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.944496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 975/1940] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:42.945408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f64be-6655-4ac2-b3c6-b4f86b6cdf0f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:42.956910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f64be-6655-4ac2-b3c6-b4f86b6cdf0f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.977499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e15d4-44c7-47ae-92bf-0fb2dd77c219 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:42.982958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:42.983634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:42.983915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:42.984195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:42.984960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:42.987078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.023059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 966/1941] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:43.024053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.027407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:43.030759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.031457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.031885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.032182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.032896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.034940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.061146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 976/1942] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:42 2021] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:43.061916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.073314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf6fad-cd4e-4fae-baf8-b6b664cf689c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.093142 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a80d03-d025-4875-9833-7757d63ede3b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.098027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c767d4a9ad7459880884eb8c546dc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.098794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.099046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.099273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.151739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.152435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.152722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.153001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.153790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.160881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.187729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.189212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.214493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 967/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:43 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:43.214892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 977/1944] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:43 2021] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:43.214991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.215717 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.237612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f9ddc-4eb0-4d6a-b646-3c2039e7f710 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.253270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c209790-d3f4-4d08-b471-70c6980d432e service glance] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.255863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.256620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.256903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.257175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.258380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.260015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.270188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.270933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.271757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.272037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.272781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.274394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.281441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 978/1945] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:43 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:43.286846 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.302612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 968/1946] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:43 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:43.304418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.309417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81c4e-abfb-4599-af08-4eddb1b88d04 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.320984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073fbc-aedf-4792-9f98-e950bf2b83d2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.324483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.325195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.325504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.325912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.327062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.328693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.337030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.337737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.338018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.338289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.339035 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.340706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.357250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 979/1947] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:43 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:43.363446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.363630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 969/1948] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:43 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:43.366714 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.379200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f60da-0498-4b7f-ac95-65114ffee1e9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.381978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076d83-4ea8-48d5-b459-31fe39baa52f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.386818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c9dc6-2285-4ab0-8f8a-26911e17584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.386917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c363f-48fa-4587-b85a-1b3ddf5fcfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.387772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c363f-48fa-4587-b85a-1b3ddf5fcfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.388055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c363f-48fa-4587-b85a-1b3ddf5fcfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.388329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c363f-48fa-4587-b85a-1b3ddf5fcfbb admin admin] PATH_INFO: `/v3/projects/ddc18c4c10ae494981e1c3456508a98e/users/b33aa16cc0c744baae25732b13745e2f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.393940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9dc6-2285-4ab0-8f8a-26911e17584d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.394238 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9dc6-2285-4ab0-8f8a-26911e17584d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.394526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c9dc6-2285-4ab0-8f8a-26911e17584d admin admin] PATH_INFO: `/v3/projects/3fec59f3c76e4c52a8c96bb3f56cb5eb/users/b48ec8e3114f45a4a6ea118ce78eeb48/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.409440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c363f-48fa-4587-b85a-1b3ddf5fcfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc18c4c10ae494981e1c3456508a98e, user_id=b33aa16cc0c744baae25732b13745e2f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.409440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c363f-48fa-4587-b85a-1b3ddf5fcfbb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.415915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c9dc6-2285-4ab0-8f8a-26911e17584d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fec59f3c76e4c52a8c96bb3f56cb5eb, user_id=b48ec8e3114f45a4a6ea118ce78eeb48, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.422078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c9dc6-2285-4ab0-8f8a-26911e17584d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.429097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 970/1949] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:43 2021] PUT /identity/v3/projects/ddc18c4c10ae494981e1c3456508a98e/users/b33aa16cc0c744baae25732b13745e2f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:43.440050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0497c8-7108-4bdc-a50c-5c1e1c8e48c1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.440363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0497c8-7108-4bdc-a50c-5c1e1c8e48c1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.440638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0497c8-7108-4bdc-a50c-5c1e1c8e48c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.461831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 980/1950] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:43 2021] PUT /identity/v3/projects/3fec59f3c76e4c52a8c96bb3f56cb5eb/users/b48ec8e3114f45a4a6ea118ce78eeb48/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:43.474477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1605fd-485d-4b91-b3af-6c1c857bd5fc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.474682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1605fd-485d-4b91-b3af-6c1c857bd5fc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.474946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1605fd-485d-4b91-b3af-6c1c857bd5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.490118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8e0497c8-7108-4bdc-a50c-5c1e1c8e48c1 None None] MFA Rules not processed for user `b33aa16cc0c744baae25732b13745e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:43.491805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8e0497c8-7108-4bdc-a50c-5c1e1c8e48c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:43.510206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0b1605fd-485d-4b91-b3af-6c1c857bd5fc None None] MFA Rules not processed for user `b48ec8e3114f45a4a6ea118ce78eeb48`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:43.524930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0b1605fd-485d-4b91-b3af-6c1c857bd5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:43.617862 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 971/1951] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:43 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:43.620025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0497c8-7108-4bdc-a50c-5c1e1c8e48c1 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.631118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 981/1952] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:43 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:43.635302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1605fd-485d-4b91-b3af-6c1c857bd5fc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.710669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0497c8-7108-4bdc-a50c-5c1e1c8e48c1 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.724350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.725539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.725943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.726393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.727184 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.732204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.759279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1605fd-485d-4b91-b3af-6c1c857bd5fc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.767555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.768561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.768990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.769466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.771125 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.773507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.782780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 972/1953] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:43 2021] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:43.783820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.810070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 982/1954] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:43 2021] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:43.814175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.867832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f79b8-20f9-47ff-a57b-e00e5ca95e8b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.904540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dbddb-5b80-4549-98f0-683cbfe62787 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.910074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.910884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.911235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.911614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.912585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.914898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.939077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:43.939844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:43.940206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:43.940559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:43.941345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:43.944098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:43.970992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 983/1955] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:43 2021] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:43.976094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:43.990515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e56ec-dcb3-416c-b7c3-a7cd485a204e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:43.996986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.004180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 973/1956] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:43 2021] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:44.008857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.012958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.013616 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.013819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.015137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.016519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.031850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 984/1957] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:43 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:44.032196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ab96f-70d2-40a4-bb23-60bbbb62c398 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.033997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.037113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.037822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.038110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.038438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.039242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.041773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.047862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c4907-17f5-4dfc-82d1-b522b4e8a4cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.056152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.057259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.057919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 974/1958] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:44.058465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.058941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.060022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.061909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.062022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.076663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9a650-9587-4a2e-b775-da77e6ab0aa0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.079414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 985/1959] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:44.084005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.085937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.086603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.086993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.087287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.089790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.092114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.105415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 975/1960] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:44.105628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fdff6-4db5-4eb8-bda1-359683732e55 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.109083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.111539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6db26f-66fe-49a1-886d-47c8a1ee6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.112473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6db26f-66fe-49a1-886d-47c8a1ee6d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.112755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6db26f-66fe-49a1-886d-47c8a1ee6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.113214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6db26f-66fe-49a1-886d-47c8a1ee6d20 admin admin] PATH_INFO: `/v3/projects/141c7b1871ab475eb3ffda6f59eb12b6/users/935bb9fa0ebf4b78ac178f376157ea90/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.120368 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc9080-3609-4e45-88e1-2d4d66b198e5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.126671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7b54-6a86-4815-9c52-081fc2b1145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.127753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7b54-6a86-4815-9c52-081fc2b1145d admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.128040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7b54-6a86-4815-9c52-081fc2b1145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.128318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7b54-6a86-4815-9c52-081fc2b1145d admin admin] PATH_INFO: `/v3/projects/f8d97ff6515141f9b55468692497e9cf/users/c5d392004a27445f895a2f230de3dd06/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.135699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6db26f-66fe-49a1-886d-47c8a1ee6d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141c7b1871ab475eb3ffda6f59eb12b6, user_id=935bb9fa0ebf4b78ac178f376157ea90, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.138413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6db26f-66fe-49a1-886d-47c8a1ee6d20 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.144220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7b54-6a86-4815-9c52-081fc2b1145d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d97ff6515141f9b55468692497e9cf, user_id=c5d392004a27445f895a2f230de3dd06, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.147360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7b54-6a86-4815-9c52-081fc2b1145d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.154952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 986/1961] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:44 2021] PUT /identity/v3/projects/141c7b1871ab475eb3ffda6f59eb12b6/users/935bb9fa0ebf4b78ac178f376157ea90/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:44.161771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 976/1962] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:44 2021] PUT /identity/v3/projects/f8d97ff6515141f9b55468692497e9cf/users/c5d392004a27445f895a2f230de3dd06/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:44.166257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a543e-5126-4527-a234-1ef948c8deda None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.166545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a543e-5126-4527-a234-1ef948c8deda None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.166822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a543e-5126-4527-a234-1ef948c8deda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.172491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e030d2d-bd87-4589-8d4a-4f943716c03c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.173001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e030d2d-bd87-4589-8d4a-4f943716c03c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.173693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e030d2d-bd87-4589-8d4a-4f943716c03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.196346 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ae6a543e-5126-4527-a234-1ef948c8deda None None] MFA Rules not processed for user `935bb9fa0ebf4b78ac178f376157ea90`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:44.197797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ae6a543e-5126-4527-a234-1ef948c8deda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:44.208127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-7e030d2d-bd87-4589-8d4a-4f943716c03c None None] MFA Rules not processed for user `c5d392004a27445f895a2f230de3dd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:44.209465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7e030d2d-bd87-4589-8d4a-4f943716c03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:44.281583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 987/1963] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:44 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:44.287303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 977/1964] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:44 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:44.289651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a543e-5126-4527-a234-1ef948c8deda None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.291660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e030d2d-bd87-4589-8d4a-4f943716c03c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.402266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e030d2d-bd87-4589-8d4a-4f943716c03c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.412438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.413746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.414087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.414365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.414799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a543e-5126-4527-a234-1ef948c8deda None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.415132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.417853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.423377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.424423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.425006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.425572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.426453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.430670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.457059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 978/1965] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:44 2021] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:44.462162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.487934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 988/1966] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:44 2021] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:44.489956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.587625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8137-b30f-479f-bdf5-881da69e2111 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.592134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef04db-e4be-473b-bfd0-e1c7baf574db admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.593630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.594451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.594916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.595261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.596153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.597674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.598249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.598500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.599398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.599750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.600639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.602921 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.633415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 989/1967] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:44 2021] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:44.633892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 979/1968] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:44 2021] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:44.635195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.636829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.651767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ab5fe-d36c-4ae1-acc2-2a553dfd59c1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.652537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3795d3-8c50-4ecf-a920-20f376504b4c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.658704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.659456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.659814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.660155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.660973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.663307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.675756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.675898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 980/1969] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:44.678426 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.678860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.679368 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.680205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.681174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.682682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.694440 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 990/1970] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:44.696235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e606c07-29c0-44bf-bc03-9810a0b738d2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.698498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.702555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.703446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.703727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.704000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] PATH_INFO: `/v3/projects/7911d17ba5ff4b7e971215b5e9a78638/users/fe37a67c8d5d4099a907840b11a4646e/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.715529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca10926-65e6-499e-aa3b-aca1dad1d247 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.726534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.727562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7911d17ba5ff4b7e971215b5e9a78638, user_id=fe37a67c8d5d4099a907840b11a4646e, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.727856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.728304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.728730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] PATH_INFO: `/v3/projects/c7d82c0778ba4524a62a998b1bedd093/users/2c4d9f177ae944b3947dab790ebd8ef6/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.731127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.757896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 981/1971] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:44 2021] PUT /identity/v3/projects/7911d17ba5ff4b7e971215b5e9a78638/users/fe37a67c8d5d4099a907840b11a4646e/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:44.766090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d82c0778ba4524a62a998b1bedd093, user_id=2c4d9f177ae944b3947dab790ebd8ef6, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.768577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.775891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.796061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 991/1972] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:44 2021] PUT /identity/v3/projects/c7d82c0778ba4524a62a998b1bedd093/users/2c4d9f177ae944b3947dab790ebd8ef6/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:44.800707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.909404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7385b-c8d4-4c98-9413-44318b01866d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.913493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7c118-1b59-41af-ab76-545cb90fd2fc admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.915086 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.916073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.916467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.916821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.917679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.919728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.932065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.932772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.933059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.933351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.934134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.935772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.940483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 982/1973] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:44.943406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.955312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dfb99-7d85-45cd-a779-6e1358b4fec4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.970741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 992/1974] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:44 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:44.971046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831bee1-d364-4bdd-ae01-4560c8ab8095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:44.971046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bee1-d364-4bdd-ae01-4560c8ab8095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:44.971046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bee1-d364-4bdd-ae01-4560c8ab8095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:44.971046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831bee1-d364-4bdd-ae01-4560c8ab8095 admin admin] PATH_INFO: `/v3/projects/7911d17ba5ff4b7e971215b5e9a78638/users/fe37a67c8d5d4099a907840b11a4646e/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:44.971373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831bee1-d364-4bdd-ae01-4560c8ab8095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7911d17ba5ff4b7e971215b5e9a78638, user_id=fe37a67c8d5d4099a907840b11a4646e, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:44.972551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:44.973125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831bee1-d364-4bdd-ae01-4560c8ab8095 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:44.985146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8dfb01-16f4-4ecf-90f2-11cb6afee640 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:44.989058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 983/1975] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:44 2021] PUT /identity/v3/projects/7911d17ba5ff4b7e971215b5e9a78638/users/fe37a67c8d5d4099a907840b11a4646e/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:45.005789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:45.005789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:45.009005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:45.056821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] MFA Rules not processed for user `fe37a67c8d5d4099a907840b11a4646e`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:45.058703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:45.105987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815fd5c9-08c0-46c5-8c26-ed17ca5b99a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:45.106894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd5c9-08c0-46c5-8c26-ed17ca5b99a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:45.107171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd5c9-08c0-46c5-8c26-ed17ca5b99a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:45.107445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815fd5c9-08c0-46c5-8c26-ed17ca5b99a4 admin admin] PATH_INFO: `/v3/projects/c7d82c0778ba4524a62a998b1bedd093/users/2c4d9f177ae944b3947dab790ebd8ef6/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:45.110622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd5c9-08c0-46c5-8c26-ed17ca5b99a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d82c0778ba4524a62a998b1bedd093, user_id=2c4d9f177ae944b3947dab790ebd8ef6, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:45.113915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815fd5c9-08c0-46c5-8c26-ed17ca5b99a4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:45.140226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 993/1976] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:44 2021] PUT /identity/v3/projects/c7d82c0778ba4524a62a998b1bedd093/users/2c4d9f177ae944b3947dab790ebd8ef6/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:45.156487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6280da-b3cc-4fff-ad0e-a0070a66c4c7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:45.157021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6280da-b3cc-4fff-ad0e-a0070a66c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:45.157478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6280da-b3cc-4fff-ad0e-a0070a66c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:45.212263 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8b6280da-b3cc-4fff-ad0e-a0070a66c4c7 None None] MFA Rules not processed for user `2c4d9f177ae944b3947dab790ebd8ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:45.213835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8b6280da-b3cc-4fff-ad0e-a0070a66c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:45.220099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 984/1977] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:45 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:45.281698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:45.283183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:45.298546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 994/1978] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:45 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:45.342432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f76558-658a-4d23-9c38-50d1067a97ce None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:45.388176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:45.388833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:45.389114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:45.389407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:45.447511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:45.448904 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:45.459035 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 985/1979] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:45 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:45.494122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6280da-b3cc-4fff-ad0e-a0070a66c4c7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:45.503771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6280da-b3cc-4fff-ad0e-a0070a66c4c7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:45.508040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:45.508685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:45.508974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:45.509289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:45.566156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:45.567619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:45.576344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 995/1980] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:45 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:45.880158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:45.888575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dcd46-ff72-4df6-b1b2-2bc013ef91b2 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:45.899803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:45.900480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:45.900765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:45.901046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:45.975097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:45.976567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:45.985830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 986/1981] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:45 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:47.486075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:47.495545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82329992-3c53-462d-b71f-be4c6137925e service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:47.499990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:47.500842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:47.501321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:47.501779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:47.582892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:47.584569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:47.601575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 996/1982] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:47 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:48.603656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:48.612771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908af01-a7b7-4610-8319-798010ce2360 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:48.618353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e93306-071c-45b4-b3d7-6cc04f771b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:48.619018 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93306-071c-45b4-b3d7-6cc04f771b40 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:48.619558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93306-071c-45b4-b3d7-6cc04f771b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:48.619874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e93306-071c-45b4-b3d7-6cc04f771b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:48.629160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e93306-071c-45b4-b3d7-6cc04f771b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:48.631426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e93306-071c-45b4-b3d7-6cc04f771b40 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:48.641197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 987/1983] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:48 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:48.657798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:48.662235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:48.790482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47740e-a148-4485-9491-aa286733abe7 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:48.804223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:48.805281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:48.806478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:48.807334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] PATH_INFO: `/v3/users/f17e6e4e22844595af5f19b414358056` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:48.809880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17e6e4e22844595af5f19b414358056)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:48.813085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:48.919295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17e6e4e22844595af5f19b414358056'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:48.934261 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17e6e4e22844595af5f19b414358056'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:48.941645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17e6e4e22844595af5f19b414358056'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:48.942329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17e6e4e22844595af5f19b414358056'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:48.964508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17e6e4e22844595af5f19b414358056'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:48.976787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 997/1984] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:48 2021] DELETE /identity/v3/users/f17e6e4e22844595af5f19b414358056 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:48.977700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a423-6951-4462-85ae-e431686744fd None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:48.978202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a423-6951-4462-85ae-e431686744fd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:48.978693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08a423-6951-4462-85ae-e431686744fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:49.001221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-bd08a423-6951-4462-85ae-e431686744fd None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:49.002893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bd08a423-6951-4462-85ae-e431686744fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:49.087103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 988/1985] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:49.098065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:49.100209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:49.168851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ae28e-fc56-44b9-b789-115cdd333ec2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:49.172709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:49.173400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:49.173699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:49.173984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:49.190773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:49.192774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:49.203309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 998/1986] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:49.544669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a423-6951-4462-85ae-e431686744fd None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:49.546577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bd08a423-6951-4462-85ae-e431686744fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:49.562118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08a423-6951-4462-85ae-e431686744fd None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:49.566768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:49.567709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:49.568025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:49.568274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] PATH_INFO: `/v3/projects/1c8596cda33f4cf3a32619a7c1cd20fc` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:49.569529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8596cda33f4cf3a32619a7c1cd20fc)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:49.571517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:49.619383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8596cda33f4cf3a32619a7c1cd20fc', 'request_id': 'req-ff893a5b-0d7f-4110-8e5b-13798b765fd8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.627129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8596cda33f4cf3a32619a7c1cd20fc', 'request_id': 'req-ff893a5b-0d7f-4110-8e5b-13798b765fd8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.634262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8596cda33f4cf3a32619a7c1cd20fc', 'request_id': 'req-ff893a5b-0d7f-4110-8e5b-13798b765fd8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.644401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] The token cache is being invalidate because project 1c8596cda33f4cf3a32619a7c1cd20fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:49.644694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.645955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.647558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 989/1987] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:49 2021] DELETE /identity/v3/projects/1c8596cda33f4cf3a32619a7c1cd20fc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:49.652712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:49.663045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9dde0-2fcf-43ba-88fe-0fc236804afa service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:49.716889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:49.717792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:49.718082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:49.718361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] PATH_INFO: `/v3/users/349a9ee681f24251a06e30672e80c4c2` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:49.719558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349a9ee681f24251a06e30672e80c4c2)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:49.721491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:49.767481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349a9ee681f24251a06e30672e80c4c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.775265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349a9ee681f24251a06e30672e80c4c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.781838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349a9ee681f24251a06e30672e80c4c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.782470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349a9ee681f24251a06e30672e80c4c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.793772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349a9ee681f24251a06e30672e80c4c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:49.799457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 999/1988] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:49 2021] DELETE /identity/v3/users/349a9ee681f24251a06e30672e80c4c2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:49.992567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:49.994392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:50.024183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff893a5b-0d7f-4110-8e5b-13798b765fd8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.110353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.111534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.112203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.112500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] PATH_INFO: `/v3/users/b48ec8e3114f45a4a6ea118ce78eeb48` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.115290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48ec8e3114f45a4a6ea118ce78eeb48)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.118347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.163387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.165262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:50.191102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48ec8e3114f45a4a6ea118ce78eeb48'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.191410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4879bb8-74cd-479f-a621-801f10633c38 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.193140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48ec8e3114f45a4a6ea118ce78eeb48'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.204264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48ec8e3114f45a4a6ea118ce78eeb48'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.209198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.211199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.212004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.212198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] PATH_INFO: `/v3/projects/d5d75fdcc31c42daa7e35c4153e3c0f7` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.216332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48ec8e3114f45a4a6ea118ce78eeb48'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.217139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8f7ad3e1-23ee-4d3f-8ebb-7d2ed72e2464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48ec8e3114f45a4a6ea118ce78eeb48'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.224190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d75fdcc31c42daa7e35c4153e3c0f7)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.226176 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.245031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 990/1989] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:49 2021] DELETE /identity/v3/users/b48ec8e3114f45a4a6ea118ce78eeb48 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:50.251100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.252116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.252625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.284291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:50.287005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:50.291109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d75fdcc31c42daa7e35c4153e3c0f7', 'request_id': 'req-4ddc521a-8fa5-4853-bf76-0bc8b7797692'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.309026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d75fdcc31c42daa7e35c4153e3c0f7', 'request_id': 'req-4ddc521a-8fa5-4853-bf76-0bc8b7797692'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.318493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d75fdcc31c42daa7e35c4153e3c0f7', 'request_id': 'req-4ddc521a-8fa5-4853-bf76-0bc8b7797692'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.331722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] The token cache is being invalidate because project d5d75fdcc31c42daa7e35c4153e3c0f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:50.332104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.333864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4ddc521a-8fa5-4853-bf76-0bc8b7797692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.336123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1000/1990] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:50 2021] DELETE /identity/v3/projects/d5d75fdcc31c42daa7e35c4153e3c0f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:50.342351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f065-6bf0-463f-bd5b-de84ebcc5581 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.346007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f065-6bf0-463f-bd5b-de84ebcc5581 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.346329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445f065-6bf0-463f-bd5b-de84ebcc5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.373907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9445f065-6bf0-463f-bd5b-de84ebcc5581 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:50.375758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9445f065-6bf0-463f-bd5b-de84ebcc5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:50.389340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 991/1991] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:50.398272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.400385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:50.488900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae8c1-7881-441e-ac50-d5abc59373ef None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.493206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.494534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.494674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.494985 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.507658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1001/1992] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:50.510542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.513161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.518406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2715-1df6-4e74-8151-ec1beba5ada8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.518703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2715-1df6-4e74-8151-ec1beba5ada8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.518981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc2715-1df6-4e74-8151-ec1beba5ada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.525329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 992/1993] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:50.662658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-32bc2715-1df6-4e74-8151-ec1beba5ada8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:50.663879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-32bc2715-1df6-4e74-8151-ec1beba5ada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:50.672074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1002/1994] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:50.678292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.692416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacad7b-e6d2-4a84-aadb-4086143c45f8 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.697806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.698864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.699156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.699436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.700169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:50.700477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.702116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.713814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 993/1995] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:48:50.718308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc2715-1df6-4e74-8151-ec1beba5ada8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.727899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc2715-1df6-4e74-8151-ec1beba5ada8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.732197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.733180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.733498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.733773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.734499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.736357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.763135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1003/1996] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:50 2021] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:50.767291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.777328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf2676-ac61-42d3-8e3e-ef7177ca82bb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.809484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.811163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:50.842862 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.843535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.843824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.844108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.844826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.846840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.868121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 994/1997] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:50 2021] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:50.872146 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.875624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3d369-2bad-4df0-bbed-6321c9a57aac admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.883430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.884097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659afb72-114c-450d-b8cf-77b8e7d8f4ac admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.884235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.884521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.884800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] PATH_INFO: `/v3/projects/3fec59f3c76e4c52a8c96bb3f56cb5eb` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.886035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fec59f3c76e4c52a8c96bb3f56cb5eb)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.887933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.888852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.889550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.889837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.890119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.890855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.892433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.903226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 995/1998] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:50.907359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.918080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1f5b3-3728-43a1-af31-5ce9b7f7d01c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.923494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:50.924188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:50.924448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:50.924730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:50.925515 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:50.927185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:50.938073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 996/1999] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:50 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:50.939641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fec59f3c76e4c52a8c96bb3f56cb5eb', 'request_id': 'req-07102750-bc59-45eb-9512-6ed8ab9fda58'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.942286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.947886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fec59f3c76e4c52a8c96bb3f56cb5eb', 'request_id': 'req-07102750-bc59-45eb-9512-6ed8ab9fda58'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.952425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48151383-7f00-4493-a488-295ce567deb1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:50.954097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fec59f3c76e4c52a8c96bb3f56cb5eb', 'request_id': 'req-07102750-bc59-45eb-9512-6ed8ab9fda58'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.965320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] The token cache is being invalidate because project 3fec59f3c76e4c52a8c96bb3f56cb5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:50.965649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.966552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:50.968084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1004/2000] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:50 2021] DELETE /identity/v3/projects/3fec59f3c76e4c52a8c96bb3f56cb5eb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:50.972024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:50.973413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:51.016499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274bf4c-d84b-47b0-a6f0-1639ed08cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.017652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bf4c-d84b-47b0-a6f0-1639ed08cfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.017785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bf4c-d84b-47b0-a6f0-1639ed08cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.018089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274bf4c-d84b-47b0-a6f0-1639ed08cfd3 admin admin] PATH_INFO: `/v3/projects/c4927dc1147f416a8dddd626c5959871/users/d687eedef6d4461ba98677372b67ad01/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.031939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274bf4c-d84b-47b0-a6f0-1639ed08cfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4927dc1147f416a8dddd626c5959871, user_id=d687eedef6d4461ba98677372b67ad01, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.034445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07102750-bc59-45eb-9512-6ed8ab9fda58 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.034606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274bf4c-d84b-47b0-a6f0-1639ed08cfd3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.039858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.041095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.041671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.041895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] PATH_INFO: `/v3/users/935bb9fa0ebf4b78ac178f376157ea90` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.043335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935bb9fa0ebf4b78ac178f376157ea90)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.046161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.049747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 997/2001] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:50 2021] PUT /identity/v3/projects/c4927dc1147f416a8dddd626c5959871/users/d687eedef6d4461ba98677372b67ad01/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:51.059849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda22ef5-bb54-4620-adf0-5675cdb89fe5 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.060198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda22ef5-bb54-4620-adf0-5675cdb89fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.060487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda22ef5-bb54-4620-adf0-5675cdb89fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.088937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-bda22ef5-bb54-4620-adf0-5675cdb89fe5 None None] MFA Rules not processed for user `d687eedef6d4461ba98677372b67ad01`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:51.090173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bda22ef5-bb54-4620-adf0-5675cdb89fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:51.092968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935bb9fa0ebf4b78ac178f376157ea90'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.100414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935bb9fa0ebf4b78ac178f376157ea90'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.107151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935bb9fa0ebf4b78ac178f376157ea90'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.107853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935bb9fa0ebf4b78ac178f376157ea90'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.119613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935bb9fa0ebf4b78ac178f376157ea90'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.126019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1005/2002] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:50 2021] DELETE /identity/v3/users/935bb9fa0ebf4b78ac178f376157ea90 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:51.153163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 998/2003] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:51 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:51.157649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.159079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:51.225320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f637-0508-49f8-9372-9dcc3f88ef13 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.230019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.230675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.230961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.231237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.231950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.233934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.259204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1006/2004] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:51 2021] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:51.263500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda22ef5-bb54-4620-adf0-5675cdb89fe5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.332441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda22ef5-bb54-4620-adf0-5675cdb89fe5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.407784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.413667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.413667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.413667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.413667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.413667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.417133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.419173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:51.435317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b37699-83c4-4595-8dcc-c7a365cbfa15 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.441413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 999/2005] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:51 2021] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:51.443822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.447348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.454342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.454642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.454930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] PATH_INFO: `/v3/projects/141c7b1871ab475eb3ffda6f59eb12b6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.456946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1eea-cf44-42ed-96d9-2f6cf2102372 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.457250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141c7b1871ab475eb3ffda6f59eb12b6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.459944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.464498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.465676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.466339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.466713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.467666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.469489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.480679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1000/2006] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:51 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:51.493591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.510767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203973-e2c5-4308-8a1b-43982274a6e7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.532160 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141c7b1871ab475eb3ffda6f59eb12b6', 'request_id': 'req-4f70b861-e976-4178-8c39-512df60af0b6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.548046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141c7b1871ab475eb3ffda6f59eb12b6', 'request_id': 'req-4f70b861-e976-4178-8c39-512df60af0b6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.560348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141c7b1871ab475eb3ffda6f59eb12b6', 'request_id': 'req-4f70b861-e976-4178-8c39-512df60af0b6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.579399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] The token cache is being invalidate because project 141c7b1871ab475eb3ffda6f59eb12b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:51.580347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.582220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.584162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1007/2007] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:51 2021] DELETE /identity/v3/projects/141c7b1871ab475eb3ffda6f59eb12b6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:51.593349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.596423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:51.598139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.599601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.599854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.600138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] PATH_INFO: `/v3/projects/cfed2d8f715f4ea1ae9445081b56c573/users/7a51e9cad0e54234bbab3bf0a8e61610/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.613826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70b861-e976-4178-8c39-512df60af0b6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.620435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfed2d8f715f4ea1ae9445081b56c573, user_id=7a51e9cad0e54234bbab3bf0a8e61610, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.623592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.625477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.626614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.626999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.627409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] PATH_INFO: `/v3/users/fe37a67c8d5d4099a907840b11a4646e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.628977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe37a67c8d5d4099a907840b11a4646e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.631834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.644122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1001/2008] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:51 2021] PUT /identity/v3/projects/cfed2d8f715f4ea1ae9445081b56c573/users/7a51e9cad0e54234bbab3bf0a8e61610/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:51.648411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.650223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:51.692843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe37a67c8d5d4099a907840b11a4646e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.706515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe37a67c8d5d4099a907840b11a4646e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.718526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe37a67c8d5d4099a907840b11a4646e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.719525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe37a67c8d5d4099a907840b11a4646e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.734660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe37a67c8d5d4099a907840b11a4646e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:51.742014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1008/2009] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:51 2021] DELETE /identity/v3/users/fe37a67c8d5d4099a907840b11a4646e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:51.746801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0b52-4b46-4e0b-980d-dbccc154ffd3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.829132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786c95e-5491-488c-ab37-42402d819fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.829889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c95e-5491-488c-ab37-42402d819fda admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.830206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c95e-5491-488c-ab37-42402d819fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.830491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786c95e-5491-488c-ab37-42402d819fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.831240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c95e-5491-488c-ab37-42402d819fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.833796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786c95e-5491-488c-ab37-42402d819fda admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.845754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1002/2010] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:51 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:51.850697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:51.852803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:51.868908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559e8cc-9f28-4975-878c-611e02614448 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:51.876410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:51.877427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.877924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.878328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] PATH_INFO: `/v3/projects/cfed2d8f715f4ea1ae9445081b56c573/users/7a51e9cad0e54234bbab3bf0a8e61610/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.883508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfed2d8f715f4ea1ae9445081b56c573, user_id=7a51e9cad0e54234bbab3bf0a8e61610, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:51.886575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:51.925425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1009/2011] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:51 2021] PUT /identity/v3/projects/cfed2d8f715f4ea1ae9445081b56c573/users/7a51e9cad0e54234bbab3bf0a8e61610/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:51.928459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:51.929810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:51.930701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:51.968625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] MFA Rules not processed for user `7a51e9cad0e54234bbab3bf0a8e61610`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:51.970138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.053499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1003/2012] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:51 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:52.060780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.062958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.063835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.065246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.129159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6f830-5db1-4f9f-a0bf-fb47f106937d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.134861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.135718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.136005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.136286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] PATH_INFO: `/v3/projects/7911d17ba5ff4b7e971215b5e9a78638` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.137574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7911d17ba5ff4b7e971215b5e9a78638)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.139515 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.142065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b315d16-3191-4d9f-b7ee-797fb712773b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.146344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b23e75-c4a6-4aaf-8ea8-392f8155342a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.146991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b23e75-c4a6-4aaf-8ea8-392f8155342a service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.147273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b23e75-c4a6-4aaf-8ea8-392f8155342a service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.147547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b23e75-c4a6-4aaf-8ea8-392f8155342a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.156463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b23e75-c4a6-4aaf-8ea8-392f8155342a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.157954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b23e75-c4a6-4aaf-8ea8-392f8155342a service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.167575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1010/2013] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:52 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:52.187770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7911d17ba5ff4b7e971215b5e9a78638', 'request_id': 'req-6bbc517d-fc78-48cd-bb08-079db8aa441d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.196913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7911d17ba5ff4b7e971215b5e9a78638', 'request_id': 'req-6bbc517d-fc78-48cd-bb08-079db8aa441d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.204195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7911d17ba5ff4b7e971215b5e9a78638', 'request_id': 'req-6bbc517d-fc78-48cd-bb08-079db8aa441d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.214111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] The token cache is being invalidate because project 7911d17ba5ff4b7e971215b5e9a78638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:52.214405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.215059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.216944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1004/2014] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:52 2021] DELETE /identity/v3/projects/7911d17ba5ff4b7e971215b5e9a78638 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:52.223560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cedf-16ba-4386-a2d2-819b13b6c55f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.223849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cedf-16ba-4386-a2d2-819b13b6c55f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.224128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771cedf-16ba-4386-a2d2-819b13b6c55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.241650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8771cedf-16ba-4386-a2d2-819b13b6c55f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:52.243066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8771cedf-16ba-4386-a2d2-819b13b6c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.294398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.296878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.307606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1011/2015] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:52.316483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefb80-6de1-44df-99f1-988c8ff6671b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.316983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefb80-6de1-44df-99f1-988c8ff6671b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.318309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefb80-6de1-44df-99f1-988c8ff6671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.339358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-49eefb80-6de1-44df-99f1-988c8ff6671b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:52.341320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-49eefb80-6de1-44df-99f1-988c8ff6671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.349912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1012/2016] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:52.354077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eefb80-6de1-44df-99f1-988c8ff6671b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.360487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc517d-fc78-48cd-bb08-079db8aa441d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.362716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eefb80-6de1-44df-99f1-988c8ff6671b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.366027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.366901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.367183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.367461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] PATH_INFO: `/v3/users/d687eedef6d4461ba98677372b67ad01` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.368672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.368798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d687eedef6d4461ba98677372b67ad01)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.369326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.369658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.369940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.370631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.370729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:52.371010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.372590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.386352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1013/2017] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:48:52.390794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.401848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9f0f2-ca35-427d-9a54-2e1f838ae99a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.407785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.408430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.408720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.409004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.409747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.411700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.419266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd687eedef6d4461ba98677372b67ad01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.420398 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd687eedef6d4461ba98677372b67ad01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.432360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd687eedef6d4461ba98677372b67ad01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.438217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd687eedef6d4461ba98677372b67ad01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.438961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f35de293-6d4c-4ac5-ad68-404ee0cfb34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd687eedef6d4461ba98677372b67ad01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:52.444878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1014/2018] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:52 2021] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:52.449040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.450774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.458510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1005/2019] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:52 2021] DELETE /identity/v3/users/d687eedef6d4461ba98677372b67ad01 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:52.462957 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.463275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.463578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.480436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:52.481686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.514249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79410040-c93d-43ab-8cde-41bc82f982e1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.541952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1006/2020] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:52.552375 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.554907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.581602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.582303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.584042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.584042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.584042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.585901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.611741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1015/2021] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:52 2021] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:52.617601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.620891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7a9ae-1bd5-4e76-81fd-83af2e6fa239 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.624828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.625509 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.625794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.626076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.627880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d82df-41e4-4d89-bb06-898180d1332a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.636695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.637708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.637708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.637976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.638770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.640572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.646190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.648566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.651437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1016/2022] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:52.655629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.660182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1007/2023] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:52.666205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c09c8-fb9d-4599-9991-b5606b081611 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.671211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f7048-6cbf-4cbb-9471-4c4cd141197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.672046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7048-6cbf-4cbb-9471-4c4cd141197b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.672438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7048-6cbf-4cbb-9471-4c4cd141197b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.672656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7048-6cbf-4cbb-9471-4c4cd141197b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.674063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f7048-6cbf-4cbb-9471-4c4cd141197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.675981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f7048-6cbf-4cbb-9471-4c4cd141197b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.687928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1017/2024] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:52.692069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.702495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4749-4d71-4a59-8a6f-23fb99cdef6e service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.707521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.708433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.708722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.709010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] PATH_INFO: `/v3/projects/86dacf7bcc964610ab3b225acf63fdae/users/dc1f77a3e03a4596a7669d384bab585b/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.724408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86dacf7bcc964610ab3b225acf63fdae, user_id=dc1f77a3e03a4596a7669d384bab585b, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.727604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.741502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1008/2025] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:52 2021] PUT /identity/v3/projects/86dacf7bcc964610ab3b225acf63fdae/users/dc1f77a3e03a4596a7669d384bab585b/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:52.753014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.753529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.753745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.785627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] MFA Rules not processed for user `dc1f77a3e03a4596a7669d384bab585b`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:52.787358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.860023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1018/2026] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:52 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:52.865210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.902914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.903761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.937756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea689-b14d-452c-a0ec-1b0d72ff9c60 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:52.950414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:52.951307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:52.951992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:52.952759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:52.953865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:52.956266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:52.986532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1009/2027] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:52 2021] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:52.986532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:52.988546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:52.999517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19489af-d1d4-42a7-bcc6-e4bbc0c23052 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.079461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.080390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.080703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.080977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] PATH_INFO: `/v3/users/b33aa16cc0c744baae25732b13745e2f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.082269 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33aa16cc0c744baae25732b13745e2f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.084749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.087237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfecc8-5a34-445c-aabb-2729046efa1a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.092293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.093450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.093960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.094357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] PATH_INFO: `/v3/projects/c4927dc1147f416a8dddd626c5959871` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.096235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4927dc1147f416a8dddd626c5959871)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.099011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.135433 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33aa16cc0c744baae25732b13745e2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.144930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33aa16cc0c744baae25732b13745e2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.151295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4927dc1147f416a8dddd626c5959871', 'request_id': 'req-bb85521a-5c47-4d96-8018-8392fbd2ab01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.154773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33aa16cc0c744baae25732b13745e2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.155686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33aa16cc0c744baae25732b13745e2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.161196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4927dc1147f416a8dddd626c5959871', 'request_id': 'req-bb85521a-5c47-4d96-8018-8392fbd2ab01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.167737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4927dc1147f416a8dddd626c5959871', 'request_id': 'req-bb85521a-5c47-4d96-8018-8392fbd2ab01'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.170387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33aa16cc0c744baae25732b13745e2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.178180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1019/2028] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:52 2021] DELETE /identity/v3/users/b33aa16cc0c744baae25732b13745e2f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:53.178956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.179246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] The token cache is being invalidate because project c4927dc1147f416a8dddd626c5959871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:53.179607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.180239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bb85521a-5c47-4d96-8018-8392fbd2ab01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.180631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.182245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1010/2029] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:52 2021] DELETE /identity/v3/projects/c4927dc1147f416a8dddd626c5959871 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:53.183460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.183956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.184247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.202361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:53.203602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.247581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617126c5-8cde-4bb7-b31f-ed0f6388905a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.252296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.252963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.253247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.253556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.254302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.256797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.271449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1011/2030] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:53.275383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.276694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.282487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1020/2031] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:53 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:53.283205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.284793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.288503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c764b1f-077b-42c8-878d-e4064632c7ce None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.293551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.294499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.294785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.295060 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] PATH_INFO: `/v3/users/7a51e9cad0e54234bbab3bf0a8e61610` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.296327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a51e9cad0e54234bbab3bf0a8e61610)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.298325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.342788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad64b58-ae5f-496e-bdac-9ed32d630455 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.344000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a51e9cad0e54234bbab3bf0a8e61610'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.344668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a51e9cad0e54234bbab3bf0a8e61610'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.346427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.347099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.347377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.347652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.349987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.357428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a51e9cad0e54234bbab3bf0a8e61610'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.360880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a51e9cad0e54234bbab3bf0a8e61610'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.362024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a51e9cad0e54234bbab3bf0a8e61610'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:53.368035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.369595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.379186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1012/2032] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:53 2021] DELETE /identity/v3/users/7a51e9cad0e54234bbab3bf0a8e61610 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:53.382962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1021/2033] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:53.383085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.383085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.469590 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9da25-7cd7-4d41-9a2e-071ea766e87a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.476611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.477312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.477649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.478264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.479168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.481350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.493499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1013/2034] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:53.497792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.508220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb44e2-65f7-4cf9-8f5c-634e91c781f3 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.513747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.514653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.514944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.515221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] PATH_INFO: `/v3/projects/8d6fd1d6ad2d4e289d9f8be1ce3c6e7b/users/87a65ec7928348ebb0f15598dc541119/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.540528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6fd1d6ad2d4e289d9f8be1ce3c6e7b, user_id=87a65ec7928348ebb0f15598dc541119, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.543637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.561217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1022/2035] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:53 2021] PUT /identity/v3/projects/8d6fd1d6ad2d4e289d9f8be1ce3c6e7b/users/87a65ec7928348ebb0f15598dc541119/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:53.565135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.576097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f83e80-f6ad-4ff1-ad9a-4d1228eaf8a6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.671703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bfd39-d175-4c7d-8716-723117a22295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.672924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfd39-d175-4c7d-8716-723117a22295 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.673212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfd39-d175-4c7d-8716-723117a22295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.673530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfd39-d175-4c7d-8716-723117a22295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.674282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bfd39-d175-4c7d-8716-723117a22295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.676254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bfd39-d175-4c7d-8716-723117a22295 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.688575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1014/2036] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:53 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:53.692774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.705138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de30ed-dbbb-4c3f-8ccc-a4fc1c7889f6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.710744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.711650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.711942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.712222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] PATH_INFO: `/v3/projects/8d6fd1d6ad2d4e289d9f8be1ce3c6e7b/users/87a65ec7928348ebb0f15598dc541119/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.714666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6fd1d6ad2d4e289d9f8be1ce3c6e7b, user_id=87a65ec7928348ebb0f15598dc541119, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.717873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:53.733415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1023/2037] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:53 2021] PUT /identity/v3/projects/8d6fd1d6ad2d4e289d9f8be1ce3c6e7b/users/87a65ec7928348ebb0f15598dc541119/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:53.741704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.741867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.742130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.805056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] MFA Rules not processed for user `87a65ec7928348ebb0f15598dc541119`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:53.806342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.846420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.849093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.944215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1015/2038] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:53 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:53.944215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:53.944215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:53.985831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e79c0-9071-4644-90bf-731982c62492 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:53.990980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:53.991845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:53.992127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:53.992402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] PATH_INFO: `/v3/projects/cfed2d8f715f4ea1ae9445081b56c573` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:53.993886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfed2d8f715f4ea1ae9445081b56c573)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:53.995794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.019128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8066fe-93d8-4e22-b22f-ad248b63b2a3 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.026521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.027513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.027902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.028289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] PATH_INFO: `/v3/projects/ddc18c4c10ae494981e1c3456508a98e` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.029666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc18c4c10ae494981e1c3456508a98e)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.031675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.046321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfed2d8f715f4ea1ae9445081b56c573', 'request_id': 'req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.055233 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfed2d8f715f4ea1ae9445081b56c573', 'request_id': 'req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.062556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfed2d8f715f4ea1ae9445081b56c573', 'request_id': 'req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.075796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] The token cache is being invalidate because project cfed2d8f715f4ea1ae9445081b56c573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:54.076089 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.077140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.079323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1024/2039] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:53 2021] DELETE /identity/v3/projects/cfed2d8f715f4ea1ae9445081b56c573 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:54.079854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.081312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.091949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc18c4c10ae494981e1c3456508a98e', 'request_id': 'req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.100695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc18c4c10ae494981e1c3456508a98e', 'request_id': 'req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.107709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc18c4c10ae494981e1c3456508a98e', 'request_id': 'req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.118389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] The token cache is being invalidate because project ddc18c4c10ae494981e1c3456508a98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:54.118797 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.119364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0ceb8e88-ba5c-4646-8a8d-e8b0d8773ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.123851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1016/2040] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:53 2021] DELETE /identity/v3/projects/ddc18c4c10ae494981e1c3456508a98e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:54.123851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.123851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.123851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.144140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:54.145900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.147745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d2b58-8fa9-4256-8d50-6396572b1ac6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.201864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296a6bc-cd31-4f65-b36e-c016a1e5de21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.202523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296a6bc-cd31-4f65-b36e-c016a1e5de21 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.202810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296a6bc-cd31-4f65-b36e-c016a1e5de21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.203179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296a6bc-cd31-4f65-b36e-c016a1e5de21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.204895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1296a6bc-cd31-4f65-b36e-c016a1e5de21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.212238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1017/2041] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:54.214304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.216990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.235085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c60134-b6da-4f50-91d3-8b41162502f5 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.240750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.242463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.242701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.243870 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] PATH_INFO: `/v3/users/c5d392004a27445f895a2f230de3dd06` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.244675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d392004a27445f895a2f230de3dd06)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.247428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.278740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296a6bc-cd31-4f65-b36e-c016a1e5de21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.280184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296a6bc-cd31-4f65-b36e-c016a1e5de21 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.290084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1025/2042] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:54 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:54.303522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.303825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.304110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.304457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d392004a27445f895a2f230de3dd06'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.310144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d392004a27445f895a2f230de3dd06'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.323654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d392004a27445f895a2f230de3dd06'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.331812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d392004a27445f895a2f230de3dd06'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.337428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d392004a27445f895a2f230de3dd06'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.339680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:54.341206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.352111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1018/2043] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:54 2021] DELETE /identity/v3/users/c5d392004a27445f895a2f230de3dd06 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:54.358791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1026/2044] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:54.365453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.413728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.415902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.433598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967039b-58bb-42b9-8144-6e2423622596 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.438730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bde1a6-432b-48f7-8dba-3040b37511d6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.448943 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.450076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.450431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.450921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.451787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:54.453553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.455949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.470674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1019/2045] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:54.475068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.486988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330b29c-c364-4bcb-b42f-558e7da3584f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.491837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.492646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.492941 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.493218 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.493968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.495871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.513982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.514714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.514992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.515546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.517978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.526249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1020/2046] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:54 2021] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:54.530536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.604456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.606030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.612601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfa009-54c0-474d-9cf0-fa682557f26e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.617095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1027/2047] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:54 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:54.620195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.620971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.621342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.621707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.622517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.625080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.651940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1021/2048] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:54 2021] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:54.656252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.671285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295d7a-a81b-46ef-b46a-28d92ccf044b service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.683485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.684406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.684783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.685237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.686184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.686656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.688473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.690717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.709328 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1028/2049] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:54 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:54.712768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ce491-1441-489a-aab4-82ff5dceb911 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.713434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.718376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.719410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.719736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.720081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] PATH_INFO: `/v3/projects/f8d97ff6515141f9b55468692497e9cf` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.721536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d97ff6515141f9b55468692497e9cf)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.724535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.725619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24961e24-e0d0-4c46-99e2-74aeea8c59bb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.731193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.731929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.732212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.732487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.733217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.735149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.745478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1029/2050] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:54 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:48:54.749744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.764220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4d441-2c8c-4f9f-92a7-16ae44316737 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.790416 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d97ff6515141f9b55468692497e9cf', 'request_id': 'req-c24abd9a-c02b-452b-ba2d-63b00d5daa98'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.802088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d97ff6515141f9b55468692497e9cf', 'request_id': 'req-c24abd9a-c02b-452b-ba2d-63b00d5daa98'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.813730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d97ff6515141f9b55468692497e9cf', 'request_id': 'req-c24abd9a-c02b-452b-ba2d-63b00d5daa98'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.826467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] The token cache is being invalidate because project f8d97ff6515141f9b55468692497e9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:54.826759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.827441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:54.829216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1022/2051] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:54 2021] DELETE /identity/v3/projects/f8d97ff6515141f9b55468692497e9cf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:54.833630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:54.834984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.846712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b60569-5490-4382-8b85-8ebfac336123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.847601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60569-5490-4382-8b85-8ebfac336123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.849158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60569-5490-4382-8b85-8ebfac336123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.849497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b60569-5490-4382-8b85-8ebfac336123 admin admin] PATH_INFO: `/v3/projects/f2b27d154adb4c40a855498f7bb0159b/users/8fdb0dde32c04ce286fd35fde49312a8/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.866015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b60569-5490-4382-8b85-8ebfac336123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b27d154adb4c40a855498f7bb0159b, user_id=8fdb0dde32c04ce286fd35fde49312a8, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:54.868834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b60569-5490-4382-8b85-8ebfac336123 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:54.890075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1030/2052] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:54 2021] PUT /identity/v3/projects/f2b27d154adb4c40a855498f7bb0159b/users/8fdb0dde32c04ce286fd35fde49312a8/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:54.896873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.897315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.897651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.929616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24abd9a-c02b-452b-ba2d-63b00d5daa98 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:54.943131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] MFA Rules not processed for user `8fdb0dde32c04ce286fd35fde49312a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:54.944422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:54.995357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:54.996262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:54.996545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:54.998038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] PATH_INFO: `/v3/users/2c4d9f177ae944b3947dab790ebd8ef6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:54.998161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4d9f177ae944b3947dab790ebd8ef6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.004016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:55.027775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1031/2053] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:54 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:55.039516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:55.041066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:55.057858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4d9f177ae944b3947dab790ebd8ef6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.058585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4d9f177ae944b3947dab790ebd8ef6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.065994 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4d9f177ae944b3947dab790ebd8ef6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.073320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4d9f177ae944b3947dab790ebd8ef6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.074062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4d9f177ae944b3947dab790ebd8ef6'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.091222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1023/2054] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:54 2021] DELETE /identity/v3/users/2c4d9f177ae944b3947dab790ebd8ef6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:55.105364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259d3f-45fb-4c32-a34b-c28c206de6ad None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:55.160589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97b16d-cfc4-4b8c-9f48-f47f7902ae12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:55.162326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b16d-cfc4-4b8c-9f48-f47f7902ae12 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.162779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b16d-cfc4-4b8c-9f48-f47f7902ae12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.163132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b16d-cfc4-4b8c-9f48-f47f7902ae12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.165351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4a97b16d-cfc4-4b8c-9f48-f47f7902ae12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:55.231301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97b16d-cfc4-4b8c-9f48-f47f7902ae12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.233736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a97b16d-cfc4-4b8c-9f48-f47f7902ae12 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:55.244523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1032/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:55 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:55.414851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:55.416606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:55.499206 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da7787-721e-4db2-9a80-b5eb202b832f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:55.517569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:55.518685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.519012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.519292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] PATH_INFO: `/v3/projects/c7d82c0778ba4524a62a998b1bedd093` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.521171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d82c0778ba4524a62a998b1bedd093)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.526405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:55.583855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d82c0778ba4524a62a998b1bedd093', 'request_id': 'req-13479ca0-1e8e-4c74-9968-77e67eaa1403'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.591262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d82c0778ba4524a62a998b1bedd093', 'request_id': 'req-13479ca0-1e8e-4c74-9968-77e67eaa1403'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.597675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d82c0778ba4524a62a998b1bedd093', 'request_id': 'req-13479ca0-1e8e-4c74-9968-77e67eaa1403'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.608555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] The token cache is being invalidate because project c7d82c0778ba4524a62a998b1bedd093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:55.608848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.609556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-13479ca0-1e8e-4c74-9968-77e67eaa1403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:55.611229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1024/2056] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:55 2021] DELETE /identity/v3/projects/c7d82c0778ba4524a62a998b1bedd093 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:55.617241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b67d3f-151c-464e-8f49-c96e70646d10 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.617572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b67d3f-151c-464e-8f49-c96e70646d10 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.617861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b67d3f-151c-464e-8f49-c96e70646d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.635714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a8b67d3f-151c-464e-8f49-c96e70646d10 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:55.636926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a8b67d3f-151c-464e-8f49-c96e70646d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:55.697009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1033/2057] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:55.705102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753b7b-5490-4269-8b9f-724249d8d5f0 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.705423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753b7b-5490-4269-8b9f-724249d8d5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.705711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56753b7b-5490-4269-8b9f-724249d8d5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.727049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-56753b7b-5490-4269-8b9f-724249d8d5f0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:55.728299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-56753b7b-5490-4269-8b9f-724249d8d5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:55.736823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1025/2058] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:55.741216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b67d3f-151c-464e-8f49-c96e70646d10 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:55.750672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b67d3f-151c-464e-8f49-c96e70646d10 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:55.755989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:55.756649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.756930 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.757206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.757987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:55.758296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.759865 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:55.772159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1034/2059] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:55.776741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56753b7b-5490-4269-8b9f-724249d8d5f0 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:55.786196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56753b7b-5490-4269-8b9f-724249d8d5f0 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:55.791115 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:55.791794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.792076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.792376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.793084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.795017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:55.822849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1026/2060] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:55 2021] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:55.827031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:55.841984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a04ab-3194-45a1-9262-c138f011d0d5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:55.904318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:55.904991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.905284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.905613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.906336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.908242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:55.931553 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1035/2061] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:55 2021] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:55.935680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:55.946443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd0b4-b33c-4af8-ad68-33cb3255fc15 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:55.951158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:55.951812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.952093 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.952367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.953119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.954729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:55.964938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1027/2062] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:55.970352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:55.981781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ab1dd-619b-43ba-9b9f-be9a159ee141 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:55.986653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65548cad-744b-4d8f-bc78-46eefe15a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:55.987314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548cad-744b-4d8f-bc78-46eefe15a11c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:55.987601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548cad-744b-4d8f-bc78-46eefe15a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:55.987883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65548cad-744b-4d8f-bc78-46eefe15a11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:55.989463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65548cad-744b-4d8f-bc78-46eefe15a11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:55.990951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65548cad-744b-4d8f-bc78-46eefe15a11c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:56.004624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1036/2063] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:55 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:56.005570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:56.016471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d937d0-0f5d-4a06-b815-6fa6ffdfe1cc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:56.021322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:56.022359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:56.022657 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:56.022939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] PATH_INFO: `/v3/projects/f77362b42a3946d1a1d832d107882917/users/5db1cc5ce6bf4dcf93b496d36f931429/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:56.038377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77362b42a3946d1a1d832d107882917, user_id=5db1cc5ce6bf4dcf93b496d36f931429, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:56.041086 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:56.056959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1028/2064] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:56 2021] PUT /identity/v3/projects/f77362b42a3946d1a1d832d107882917/users/5db1cc5ce6bf4dcf93b496d36f931429/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:56.067129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:56.067432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:56.067717 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:56.096539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] MFA Rules not processed for user `5db1cc5ce6bf4dcf93b496d36f931429`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:56.098015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:56.170248 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1037/2065] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:56 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:56.182497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:56.184391 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:56.245707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b898f6-b824-459f-919e-d1b973c3bdc4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:56.249399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd9f1f-afdc-4ee5-af34-71b9737a35f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c767d4a9ad7459880884eb8c546dc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:56.249981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd9f1f-afdc-4ee5-af34-71b9737a35f0 service glance] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:56.250265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd9f1f-afdc-4ee5-af34-71b9737a35f0 service glance] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:56.250542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd9f1f-afdc-4ee5-af34-71b9737a35f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:56.258972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd9f1f-afdc-4ee5-af34-71b9737a35f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:56.260339 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd9f1f-afdc-4ee5-af34-71b9737a35f0 service glance] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:56.268982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1029/2066] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:56 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:57.870774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:57.872257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:57.954620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc85f-baf3-47df-9126-1f88ea572813 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:57.964068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:57.964942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:57.965285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:57.965545 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] PATH_INFO: `/v3/users/8fdb0dde32c04ce286fd35fde49312a8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:57.967028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdb0dde32c04ce286fd35fde49312a8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:57.969249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:58.046587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdb0dde32c04ce286fd35fde49312a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.056307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdb0dde32c04ce286fd35fde49312a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.064384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdb0dde32c04ce286fd35fde49312a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.065085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdb0dde32c04ce286fd35fde49312a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.078863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdb0dde32c04ce286fd35fde49312a8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.085962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1038/2067] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:57 2021] DELETE /identity/v3/users/8fdb0dde32c04ce286fd35fde49312a8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:58.090709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.091462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.091780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.119312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:58.120993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.207719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1030/2068] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:58.215196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:58.217097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.281986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:58.283359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763456fe-0aee-4e90-835b-3711a7a2c146 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:58.283485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.287770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ef7c0-575c-4606-bdf2-573fe309808d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:58.288424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef7c0-575c-4606-bdf2-573fe309808d service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.288714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef7c0-575c-4606-bdf2-573fe309808d service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.288998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ef7c0-575c-4606-bdf2-573fe309808d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.295878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b373fd-6354-47b5-870c-fb3ad2eefa05 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:58.299017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ef7c0-575c-4606-bdf2-573fe309808d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:58.300431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ef7c0-575c-4606-bdf2-573fe309808d service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:58.300913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:58.301877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.302349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.303322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] PATH_INFO: `/v3/users/7b312fe0e6b64a5eacbb17cc545ce8ab` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.304678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b312fe0e6b64a5eacbb17cc545ce8ab)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:58.307147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:58.311415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1039/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:58.358600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b312fe0e6b64a5eacbb17cc545ce8ab'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.359313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b312fe0e6b64a5eacbb17cc545ce8ab'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.372362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b312fe0e6b64a5eacbb17cc545ce8ab'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.381271 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b312fe0e6b64a5eacbb17cc545ce8ab'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.382017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b312fe0e6b64a5eacbb17cc545ce8ab'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.401064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1031/2070] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:58 2021] DELETE /identity/v3/users/7b312fe0e6b64a5eacbb17cc545ce8ab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:58.405587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.405887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.406178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.426084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:58.426744 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.499708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1040/2071] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:58.509698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:58.511270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.583044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9017e-7148-4b18-9e4b-666c0e2ce961 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:58.588486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1be80c-d2e4-455b-a1e3-94575f0eda1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:58.588914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be80c-d2e4-455b-a1e3-94575f0eda1f service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.589253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be80c-d2e4-455b-a1e3-94575f0eda1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.589672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1be80c-d2e4-455b-a1e3-94575f0eda1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.601078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1be80c-d2e4-455b-a1e3-94575f0eda1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:58.602756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1be80c-d2e4-455b-a1e3-94575f0eda1f service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:58.609469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:58.611408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.615252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1032/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:48:58.625581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c3b60-881e-4f10-a35b-fbf22e170048 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:58.631834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:58.632702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.632986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.633571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] PATH_INFO: `/v3/projects/f2b27d154adb4c40a855498f7bb0159b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.634840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b27d154adb4c40a855498f7bb0159b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:58.637015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:58.715103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b27d154adb4c40a855498f7bb0159b', 'request_id': 'req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.733629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b27d154adb4c40a855498f7bb0159b', 'request_id': 'req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.749154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b27d154adb4c40a855498f7bb0159b', 'request_id': 'req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.762267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] The token cache is being invalidate because project f2b27d154adb4c40a855498f7bb0159b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:58.762559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.763248 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a6c5c1ac-01fb-4ddf-9f8d-5518a86c22d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:58.764782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1041/2073] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:58 2021] DELETE /identity/v3/projects/f2b27d154adb4c40a855498f7bb0159b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:58.770584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a557-bf0f-4b49-918b-d9f7b7bed7ad None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.770988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a557-bf0f-4b49-918b-d9f7b7bed7ad None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.772057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a557-bf0f-4b49-918b-d9f7b7bed7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.792154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5d15a557-bf0f-4b49-918b-d9f7b7bed7ad None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:58.793928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5d15a557-bf0f-4b49-918b-d9f7b7bed7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.882843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1033/2074] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:58.893339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fe349-6eeb-4cb8-be90-08e2ab9c7933 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.893879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fe349-6eeb-4cb8-be90-08e2ab9c7933 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.893963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fe349-6eeb-4cb8-be90-08e2ab9c7933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.913002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b01fe349-6eeb-4cb8-be90-08e2ab9c7933 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:58.914276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b01fe349-6eeb-4cb8-be90-08e2ab9c7933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:58.929459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1042/2075] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:58.934058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a557-bf0f-4b49-918b-d9f7b7bed7ad None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:58.946401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a557-bf0f-4b49-918b-d9f7b7bed7ad None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:58.953041 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:58.953878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:58.954330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:58.954908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:58.955787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:48:58.956978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:58.963369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:58.977100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1034/2076] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:48:58.983086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fe349-6eeb-4cb8-be90-08e2ab9c7933 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:58.993504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fe349-6eeb-4cb8-be90-08e2ab9c7933 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:58.997134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:58.999895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.010295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.011973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.012641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.013113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.015838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.023810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.038488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9979aa-c16a-4da1-a11d-f2194140c169 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.046236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.047287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.047769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.048230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] PATH_INFO: `/v3/projects/0702e839e6394bf59278489eaede4933` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.050333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] RBAC: Authorizing `identity:delete_project(project_id=0702e839e6394bf59278489eaede4933)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.052782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.061469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1043/2077] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:48:58 2021] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:48:59.073247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.101464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0702e839e6394bf59278489eaede4933', 'request_id': 'req-157bb1fe-941d-45e8-91b8-18f0917c40af'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.109039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0702e839e6394bf59278489eaede4933', 'request_id': 'req-157bb1fe-941d-45e8-91b8-18f0917c40af'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.121252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0702e839e6394bf59278489eaede4933', 'request_id': 'req-157bb1fe-941d-45e8-91b8-18f0917c40af'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.134175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] The token cache is being invalidate because project 0702e839e6394bf59278489eaede4933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:59.134462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.135119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.135527 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa10f5f-2b9a-4ee7-b55d-e5ae99b2290f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.136856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1035/2078] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:58 2021] DELETE /identity/v3/projects/0702e839e6394bf59278489eaede4933 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:59.141201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.142726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.198396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.199078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.199368 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.199652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.200468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.202439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.214338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb1fe-941d-45e8-91b8-18f0917c40af admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.219523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.220401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.220749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.220955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] PATH_INFO: `/v3/users/55797b1b4657485594de7a80ef9743a2` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.222225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55797b1b4657485594de7a80ef9743a2)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.224186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.224299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1044/2079] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:48:59 2021] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:48:59.229148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.231003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.243590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315771e-3c6d-4681-8cf7-c26c0041def2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.248858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.249570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.249861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.250147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.250970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.252748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.264790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1045/2080] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:59 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:59.271391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.280336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55797b1b4657485594de7a80ef9743a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.281153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55797b1b4657485594de7a80ef9743a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.281262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce0e2a-89e5-4690-8657-508b37683c15 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.287157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.287965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.288294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.288759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.289699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.290970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.297476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55797b1b4657485594de7a80ef9743a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.302974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1046/2081] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:48:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:48:59.306009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55797b1b4657485594de7a80ef9743a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.306720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-474c2a88-5c20-4218-b029-f9c6bae73f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55797b1b4657485594de7a80ef9743a2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.307467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.309682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.325091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1036/2082] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:59 2021] DELETE /identity/v3/users/55797b1b4657485594de7a80ef9743a2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:48:59.332734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0465b03-2b55-4758-829d-1a368ddaf402 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.400999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.401946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.402220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.402544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] PATH_INFO: `/v3/projects/5ad87ed5fc5c4435912fc02c040e759a/users/e3eaf109f6794bb5b46e844193ffb556/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.418302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad87ed5fc5c4435912fc02c040e759a, user_id=e3eaf109f6794bb5b46e844193ffb556, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.421409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.439591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1047/2083] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:48:59 2021] PUT /identity/v3/projects/5ad87ed5fc5c4435912fc02c040e759a/users/e3eaf109f6794bb5b46e844193ffb556/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:59.450228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.450594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.450783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.455583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.457555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.480963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] MFA Rules not processed for user `e3eaf109f6794bb5b46e844193ffb556`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:59.482150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.541955 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562010-5e6f-4d0a-baa9-7d3943275c7f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.547580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.548743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.549098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.549480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] PATH_INFO: `/v3/users/dc1f77a3e03a4596a7669d384bab585b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.551112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1f77a3e03a4596a7669d384bab585b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.553794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.558546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1037/2084] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:59 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:59.569311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.570873 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.610275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1f77a3e03a4596a7669d384bab585b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.620588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1f77a3e03a4596a7669d384bab585b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.628007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1f77a3e03a4596a7669d384bab585b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.628824 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1f77a3e03a4596a7669d384bab585b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.641599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1f77a3e03a4596a7669d384bab585b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.646264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabbd5f-130e-4f9a-92b2-190f6a68ac24 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.654642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1048/2085] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:48:59 2021] DELETE /identity/v3/users/dc1f77a3e03a4596a7669d384bab585b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:59.655042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b422e6-7f8f-46d3-b609-351f3dcb5e7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.655166 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.655256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b422e6-7f8f-46d3-b609-351f3dcb5e7d service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.655256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b422e6-7f8f-46d3-b609-351f3dcb5e7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.655256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b422e6-7f8f-46d3-b609-351f3dcb5e7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.655256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-61b422e6-7f8f-46d3-b609-351f3dcb5e7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.659919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.675781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b422e6-7f8f-46d3-b609-351f3dcb5e7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.677241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b422e6-7f8f-46d3-b609-351f3dcb5e7d service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.686855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1038/2086] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:59 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:48:59.688111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.688402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.688681 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.708303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:59.709769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.739606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95503882-d67f-4974-9b47-979facdaa6d3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.745449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.746793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.746793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.747402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] PATH_INFO: `/v3/projects/299df45394114a0ba70529a0f10a8383` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.748807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] RBAC: Authorizing `identity:delete_project(project_id=299df45394114a0ba70529a0f10a8383)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.750860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.788589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1039/2087] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:48:59.795517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:48:59.796908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.807012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299df45394114a0ba70529a0f10a8383', 'request_id': 'req-6b396dff-4036-4e6d-b26c-f5b4312bfbef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.815024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299df45394114a0ba70529a0f10a8383', 'request_id': 'req-6b396dff-4036-4e6d-b26c-f5b4312bfbef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.823061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299df45394114a0ba70529a0f10a8383', 'request_id': 'req-6b396dff-4036-4e6d-b26c-f5b4312bfbef'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.834950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] The token cache is being invalidate because project 299df45394114a0ba70529a0f10a8383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:48:59.835149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.835713 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6b396dff-4036-4e6d-b26c-f5b4312bfbef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:48:59.837300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1049/2088] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:48:59 2021] DELETE /identity/v3/projects/299df45394114a0ba70529a0f10a8383 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:48:59.845526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9236d3-2c85-4b3c-8ec8-b05ab63ae0cc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.846010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9236d3-2c85-4b3c-8ec8-b05ab63ae0cc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.846398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9236d3-2c85-4b3c-8ec8-b05ab63ae0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.867640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-af9236d3-2c85-4b3c-8ec8-b05ab63ae0cc None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:59.868842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-af9236d3-2c85-4b3c-8ec8-b05ab63ae0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.877982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e284-0c4c-4cd0-af3f-76cc525f3c55 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:48:59.936803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1050/2089] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:59.944994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8b926-1ab4-4782-92c5-221db00858ea None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.945736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8b926-1ab4-4782-92c5-221db00858ea None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.946181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8b926-1ab4-4782-92c5-221db00858ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.970358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:48:59.971349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:48:59.971779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:48:59.972232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:48:59.975301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.980704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b4a8b926-1ab4-4782-92c5-221db00858ea None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:48:59.982138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b4a8b926-1ab4-4782-92c5-221db00858ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:48:59.991095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1051/2090] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:48:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:48:59.993969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:48:59.995621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:48:59.996259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8b926-1ab4-4782-92c5-221db00858ea None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.007627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1040/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:48:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:00.015566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8b926-1ab4-4782-92c5-221db00858ea None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.031191 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.031970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.032387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.032733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.033580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:00.034073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.039305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.055000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1052/2092] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:48:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:00.060445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.078175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dea95-aa45-4d03-8056-720b2a1a1e20 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.086319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.087149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.088798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.089236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.090106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.092760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.131702 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1041/2093] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:00 2021] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:00.135758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.147855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e869-a1e7-4bc0-bc4c-482cf7e3f3a6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.206365 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.207033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.207319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.207599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.208307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.210838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.235619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1053/2094] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:00 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:00.239535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.249920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce37e3-6198-4d63-ac1e-8d93f00cb7fb admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.256386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.257213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.257698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.258227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.259292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.261555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.276193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1042/2095] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:00 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:00.279864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.292216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac061a2-a85b-4256-bd69-bba1dd0fa2f2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.297815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.298477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.298937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.299482 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.300397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.303710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.323433 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1054/2096] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:00 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:00.324602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.341271 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea03eed-08d8-43c5-80d4-e30c41b4a328 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.346991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eaaf2b-f137-461a-909a-8d20273ef4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.348388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaaf2b-f137-461a-909a-8d20273ef4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.348675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaaf2b-f137-461a-909a-8d20273ef4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.348952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eaaf2b-f137-461a-909a-8d20273ef4a8 admin admin] PATH_INFO: `/v3/projects/1fc525734a6e48e98bcf53c93c18227e/users/042e8ee177034da0ba2dd7d1346fb1ea/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.372950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eaaf2b-f137-461a-909a-8d20273ef4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc525734a6e48e98bcf53c93c18227e, user_id=042e8ee177034da0ba2dd7d1346fb1ea, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.376227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eaaf2b-f137-461a-909a-8d20273ef4a8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.387332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.389430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:00.405285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04204085-22fe-4100-9316-dca64f0ea689 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.409475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1043/2097] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:00 2021] PUT /identity/v3/projects/1fc525734a6e48e98bcf53c93c18227e/users/042e8ee177034da0ba2dd7d1346fb1ea/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:00.423130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801962-d8df-485e-ab8e-d3e2f5720876 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.424055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801962-d8df-485e-ab8e-d3e2f5720876 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.424505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac801962-d8df-485e-ab8e-d3e2f5720876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.468726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ac801962-d8df-485e-ab8e-d3e2f5720876 None None] MFA Rules not processed for user `042e8ee177034da0ba2dd7d1346fb1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:00.470107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ac801962-d8df-485e-ab8e-d3e2f5720876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:00.482573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.483540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.483900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.484251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] PATH_INFO: `/v3/projects/86dacf7bcc964610ab3b225acf63fdae` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.485561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86dacf7bcc964610ab3b225acf63fdae)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.487547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.543412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1044/2098] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:00 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:00.543625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86dacf7bcc964610ab3b225acf63fdae', 'request_id': 'req-a128fa94-3f9a-44ed-b9f6-e65f493fa088'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.544551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801962-d8df-485e-ab8e-d3e2f5720876 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.550051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86dacf7bcc964610ab3b225acf63fdae', 'request_id': 'req-a128fa94-3f9a-44ed-b9f6-e65f493fa088'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.557551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86dacf7bcc964610ab3b225acf63fdae', 'request_id': 'req-a128fa94-3f9a-44ed-b9f6-e65f493fa088'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.558078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac801962-d8df-485e-ab8e-d3e2f5720876 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.570568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] The token cache is being invalidate because project 86dacf7bcc964610ab3b225acf63fdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:00.570792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.571472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.576131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1055/2099] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:00 2021] DELETE /identity/v3/projects/86dacf7bcc964610ab3b225acf63fdae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:00.577218 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.578803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:00.619871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.620631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.620961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.621345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.622826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.625431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.651292 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128fa94-3f9a-44ed-b9f6-e65f493fa088 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.657039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.658063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1045/2100] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:00 2021] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:00.658896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.659623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.659962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] PATH_INFO: `/v3/users/87a65ec7928348ebb0f15598dc541119` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.662305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a65ec7928348ebb0f15598dc541119)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.665474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.666564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.668458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:00.725626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a65ec7928348ebb0f15598dc541119'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.733691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a65ec7928348ebb0f15598dc541119'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.743268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455978a-f70a-4be4-a729-765bd9867557 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.745649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a65ec7928348ebb0f15598dc541119'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.746719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a65ec7928348ebb0f15598dc541119'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.751802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.752608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.752993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.753389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.754215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.756282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.762811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a65ec7928348ebb0f15598dc541119'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.768773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1056/2101] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:00 2021] DELETE /identity/v3/users/87a65ec7928348ebb0f15598dc541119 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:00.772363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.772363 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:00.785800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1046/2102] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:00 2021] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:00.789527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.791150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:00.803274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaad05-2271-420d-934e-3b5c4bd89b4b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.847636 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a7a31-4ccf-43e0-9e02-167973045e63 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.854776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.855894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.856194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.856476 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] PATH_INFO: `/v3/users/b24c2c2de0d9467791de67e2c93ae0b2` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.857913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24c2c2de0d9467791de67e2c93ae0b2)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.859831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.872406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.873077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.873490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.873829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.874570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.876171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.889514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1047/2103] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:00 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:00.891585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.906217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef2ae0-cb4d-4c76-a165-cadb8b9a3cb7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:00.910624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:00.911584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:00.912535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24c2c2de0d9467791de67e2c93ae0b2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.913776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:00.914283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] PATH_INFO: `/v3/projects/3ea3050e40a84c93ab70f453e60d0b18/users/06323444c4ae40f591b7e0d7815ea89f/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:00.921776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24c2c2de0d9467791de67e2c93ae0b2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.937491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24c2c2de0d9467791de67e2c93ae0b2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.938537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24c2c2de0d9467791de67e2c93ae0b2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.946634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea3050e40a84c93ab70f453e60d0b18, user_id=06323444c4ae40f591b7e0d7815ea89f, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:00.949360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:00.963282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24c2c2de0d9467791de67e2c93ae0b2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:00.971774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1048/2104] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:00 2021] PUT /identity/v3/projects/3ea3050e40a84c93ab70f453e60d0b18/users/06323444c4ae40f591b7e0d7815ea89f/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:00.976120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:00.980596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:00.983970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1057/2105] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:00 2021] DELETE /identity/v3/users/b24c2c2de0d9467791de67e2c93ae0b2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:01.072158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190a3f0-b579-4f75-84b4-af0a88db4ea8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.104016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.105619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.152907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.153928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.154216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.154495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.155249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.160076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.194369 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1049/2106] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:00 2021] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:01.198753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.210874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ca576-f7b8-4eb8-8be0-26fd1b038e45 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.221563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.223030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.223388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.223844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] PATH_INFO: `/v3/projects/3ea3050e40a84c93ab70f453e60d0b18/users/06323444c4ae40f591b7e0d7815ea89f/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.226024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76290c58-8e9c-4319-bef6-cba810298dfd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.227710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea3050e40a84c93ab70f453e60d0b18, user_id=06323444c4ae40f591b7e0d7815ea89f, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.230929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.232008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.232939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.233295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.233672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] PATH_INFO: `/v3/projects/8d6fd1d6ad2d4e289d9f8be1ce3c6e7b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.235068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6fd1d6ad2d4e289d9f8be1ce3c6e7b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.236989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.246219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1050/2107] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:01 2021] PUT /identity/v3/projects/3ea3050e40a84c93ab70f453e60d0b18/users/06323444c4ae40f591b7e0d7815ea89f/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:01.254969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.254969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.307282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6fd1d6ad2d4e289d9f8be1ce3c6e7b', 'request_id': 'req-dee8e08e-d63c-4612-8568-9bd14885fab6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.316694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6fd1d6ad2d4e289d9f8be1ce3c6e7b', 'request_id': 'req-dee8e08e-d63c-4612-8568-9bd14885fab6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.324866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6fd1d6ad2d4e289d9f8be1ce3c6e7b', 'request_id': 'req-dee8e08e-d63c-4612-8568-9bd14885fab6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.337582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] The token cache is being invalidate because project 8d6fd1d6ad2d4e289d9f8be1ce3c6e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:01.341674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.346358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dee8e08e-d63c-4612-8568-9bd14885fab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.356007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1058/2108] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:01 2021] DELETE /identity/v3/projects/8d6fd1d6ad2d4e289d9f8be1ce3c6e7b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:01.357663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531800-7d1b-4ace-a537-916a606ba992 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.358077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531800-7d1b-4ace-a537-916a606ba992 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.358467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531800-7d1b-4ace-a537-916a606ba992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.363885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756aed9-40c6-4e7a-b14d-6f3c43933ae2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.387656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7f531800-7d1b-4ace-a537-916a606ba992 None None] MFA Rules not processed for user `06323444c4ae40f591b7e0d7815ea89f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:01.389054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7f531800-7d1b-4ace-a537-916a606ba992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.423132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.423990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.424272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.424544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] PATH_INFO: `/v3/projects/1e3793eca5f44becb0da2d9372080d65` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.426148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3793eca5f44becb0da2d9372080d65)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.427849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.460155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1059/2109] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:01.461468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf350da-3ba4-4f4c-a478-8c6f98b8c9c6 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.461764 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf350da-3ba4-4f4c-a478-8c6f98b8c9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.462042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf350da-3ba4-4f4c-a478-8c6f98b8c9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.479704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3793eca5f44becb0da2d9372080d65', 'request_id': 'req-a1b66555-cf7e-4333-b37f-634b86aef230'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.482474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1bf350da-3ba4-4f4c-a478-8c6f98b8c9c6 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:01.483668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1bf350da-3ba4-4f4c-a478-8c6f98b8c9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.487023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3793eca5f44becb0da2d9372080d65', 'request_id': 'req-a1b66555-cf7e-4333-b37f-634b86aef230'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.493505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3793eca5f44becb0da2d9372080d65', 'request_id': 'req-a1b66555-cf7e-4333-b37f-634b86aef230'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.503568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] The token cache is being invalidate because project 1e3793eca5f44becb0da2d9372080d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:01.503872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.504517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:01.506104 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1051/2110] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:01 2021] DELETE /identity/v3/projects/1e3793eca5f44becb0da2d9372080d65 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:01.506852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.508111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.543147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1060/2111] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:01.544505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df7dd-60d4-47df-b889-fc462fbf6ea5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.544797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df7dd-60d4-47df-b889-fc462fbf6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.545073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df7dd-60d4-47df-b889-fc462fbf6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.564746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-af4df7dd-60d4-47df-b889-fc462fbf6ea5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:01.565406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66555-cf7e-4333-b37f-634b86aef230 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.566171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-af4df7dd-60d4-47df-b889-fc462fbf6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.569202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.569945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.570224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.570498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.572494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.583004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1061/2112] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:01.583004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706410-ede9-415e-a91e-1ee6876ddee5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.583004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706410-ede9-415e-a91e-1ee6876ddee5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.583004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0706410-ede9-415e-a91e-1ee6876ddee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.602979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a0706410-ede9-415e-a91e-1ee6876ddee5 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:01.604077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a0706410-ede9-415e-a91e-1ee6876ddee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.611874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1062/2113] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:01.613211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f815582-72c1-4fa7-836d-6908bf9ffe47 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.613536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f815582-72c1-4fa7-836d-6908bf9ffe47 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.613817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f815582-72c1-4fa7-836d-6908bf9ffe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.631635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-5f815582-72c1-4fa7-836d-6908bf9ffe47 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:01.632806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5f815582-72c1-4fa7-836d-6908bf9ffe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.634525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.635754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.641648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1063/2114] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:01.642478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f815582-72c1-4fa7-836d-6908bf9ffe47 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.647372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1052/2115] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:01.648166 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.652338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f815582-72c1-4fa7-836d-6908bf9ffe47 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.657247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.657858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c1fb6-bf9a-4e4e-a86f-418013c0c8a8 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.658049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.658410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.658694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.659420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:01.659772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.661311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.663564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.664746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.664876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.665180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.666013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:01.666373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.667995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.673949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1064/2116] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:01.678211 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.681766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1053/2117] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:01.684811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.688262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59995a-1344-4279-898c-13752a02803b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.693002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.693697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.693984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.694268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.695136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.696974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f7184-eff3-4286-9bfe-c3f230f3eba3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.697252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.702286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.702995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.703285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.703548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.704307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.706401 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.728104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1065/2118] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:01.732236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.741212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1054/2119] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:01.742552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.805150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c411df-cd9e-4546-81fb-4d7c0e6baa52 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.809773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.810581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.810864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.811142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.811844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.813641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951297cc-8586-4206-83b2-037e415550d9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.813753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.818764 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.819465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.819737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.820014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.820717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.822642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.835536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1066/2120] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:01.836462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.844289 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1055/2121] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:01 2021] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:01.844974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.854229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53ef09-2e24-4b90-9b35-dc138e740fea admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.858848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.859479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.859770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.860049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.860769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.862489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.875585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1056/2122] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:01.875585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.890422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd81ac-0c8b-495f-bcde-1193a934d326 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.893576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846b763-5967-49e1-b15b-8cd696a6f8d8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.895373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.896233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.897020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.897302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.898112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.898427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.899180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.899529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.899746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.899928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.902254 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:01.915919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1057/2123] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:01.915919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.927939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbcf59-843b-408e-b6dd-d20b66f0436c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.933271 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.934003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.934285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.934562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.935303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.936899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.947871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1058/2124] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:01.948671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.960276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250de4fc-9c2f-466b-b896-413a5826ce79 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.964975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:01.965629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:01.965937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.966629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:01.966629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:01.967172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:01.968042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.968704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:01.977275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1067/2125] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:01.978190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.978726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1059/2126] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:01.982761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:01.992256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bf9a6-c66e-40ea-a38b-20bcb5790830 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:01.993149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afdc08-5d1d-4caf-b548-9f0c925ae73b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.004924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0b8a3-70b1-4122-a7f4-7b767f7fb980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.006534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0085b-4358-468b-9d1a-64603944e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.007587 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0085b-4358-468b-9d1a-64603944e967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.007761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0085b-4358-468b-9d1a-64603944e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.007983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0085b-4358-468b-9d1a-64603944e967 admin admin] PATH_INFO: `/v3/projects/fcc08699515f48a08c8ac1507eec9cae/users/d0a7e5d6194743b8b1e97ab17e15c72f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.009956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0b8a3-70b1-4122-a7f4-7b767f7fb980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.010709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0b8a3-70b1-4122-a7f4-7b767f7fb980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.012188 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0b8a3-70b1-4122-a7f4-7b767f7fb980 admin admin] PATH_INFO: `/v3/projects/69986db4b2f0447f867d268295aad735/users/3677b0d7d64e45e0a52c05bd70936dda/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.028760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0085b-4358-468b-9d1a-64603944e967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc08699515f48a08c8ac1507eec9cae, user_id=d0a7e5d6194743b8b1e97ab17e15c72f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.029279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0b8a3-70b1-4122-a7f4-7b767f7fb980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69986db4b2f0447f867d268295aad735, user_id=3677b0d7d64e45e0a52c05bd70936dda, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.031520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0085b-4358-468b-9d1a-64603944e967 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.032603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0b8a3-70b1-4122-a7f4-7b767f7fb980 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.051407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1068/2127] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:01 2021] PUT /identity/v3/projects/69986db4b2f0447f867d268295aad735/users/3677b0d7d64e45e0a52c05bd70936dda/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:02.057305 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1060/2128] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:01 2021] PUT /identity/v3/projects/fcc08699515f48a08c8ac1507eec9cae/users/d0a7e5d6194743b8b1e97ab17e15c72f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:02.061786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7de9-7e19-4dfa-a97c-e73c6264cf70 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.061998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.062421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.062710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.062935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7de9-7e19-4dfa-a97c-e73c6264cf70 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.063370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c7de9-7e19-4dfa-a97c-e73c6264cf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.080440 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:02.082144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:02.093015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b64c7de9-7e19-4dfa-a97c-e73c6264cf70 None None] MFA Rules not processed for user `3677b0d7d64e45e0a52c05bd70936dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:02.094514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b64c7de9-7e19-4dfa-a97c-e73c6264cf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:02.146561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1069/2129] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:02.157464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.159046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:02.181536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1061/2130] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:02 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:02.185843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c7de9-7e19-4dfa-a97c-e73c6264cf70 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.199589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c7de9-7e19-4dfa-a97c-e73c6264cf70 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.206954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.207700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.208187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.208304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.209116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.211204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.221443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f35daf-0020-47bc-929b-4c619e723a33 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.226062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.226933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.227223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.227512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.245675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1062/2131] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:02 2021] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:02.253638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.257642 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.259141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.270509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1070/2132] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:02.334164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966298c-76d9-494f-a8e8-9ca8f5a2ba6b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.339208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.340159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.340457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.341328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.342264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.344419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.370031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1063/2133] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:02 2021] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:02.371753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.384021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d729f-fe43-4259-a4a6-9a062e488e11 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.389517 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.390180 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.390468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.390753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.391540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.393063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.406825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1071/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:02 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:02.408601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.419236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5279b-3ca2-4bb2-bcd2-b0597d6dd421 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.424518 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.425433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.425725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.426006 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] PATH_INFO: `/v3/projects/83de2e4f56a04320bd69383ecc1df707/users/244e4e19917b4372b1be77822bb14d48/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.441402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83de2e4f56a04320bd69383ecc1df707, user_id=244e4e19917b4372b1be77822bb14d48, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.444836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.460120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1064/2135] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:02 2021] PUT /identity/v3/projects/83de2e4f56a04320bd69383ecc1df707/users/244e4e19917b4372b1be77822bb14d48/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:02.464018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.475425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7f01-afc6-4fa1-96f3-6d83a023c80d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.531957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193936c6-66b4-4a41-b5b9-656b995caa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.532625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193936c6-66b4-4a41-b5b9-656b995caa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.532911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193936c6-66b4-4a41-b5b9-656b995caa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.533193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193936c6-66b4-4a41-b5b9-656b995caa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.533980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193936c6-66b4-4a41-b5b9-656b995caa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.535543 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193936c6-66b4-4a41-b5b9-656b995caa8b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.546335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1072/2136] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:02 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:02.550319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.561583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03d0d2-415a-4cbf-9bdd-8f8bf88e1ee6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.566638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.567589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.568819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.568819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] PATH_INFO: `/v3/projects/83de2e4f56a04320bd69383ecc1df707/users/244e4e19917b4372b1be77822bb14d48/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.572710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83de2e4f56a04320bd69383ecc1df707, user_id=244e4e19917b4372b1be77822bb14d48, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.576020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.589188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1065/2137] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:02 2021] PUT /identity/v3/projects/83de2e4f56a04320bd69383ecc1df707/users/244e4e19917b4372b1be77822bb14d48/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:02.600134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5a06a-ba7a-4290-b68e-49d37b1172f8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.603066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5a06a-ba7a-4290-b68e-49d37b1172f8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.603443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5a06a-ba7a-4290-b68e-49d37b1172f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.631702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-09d5a06a-ba7a-4290-b68e-49d37b1172f8 None None] MFA Rules not processed for user `244e4e19917b4372b1be77822bb14d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:02.633045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-09d5a06a-ba7a-4290-b68e-49d37b1172f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:02.705362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1073/2138] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:02 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:02.715516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:02.770344 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af46dc-e4c9-4d1d-b16f-8eed9c3d51a4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:02.774163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490966e-fd36-4c84-8a8a-1eea67c32106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:02.774805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490966e-fd36-4c84-8a8a-1eea67c32106 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:02.775092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490966e-fd36-4c84-8a8a-1eea67c32106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:02.775371 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490966e-fd36-4c84-8a8a-1eea67c32106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:02.785666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490966e-fd36-4c84-8a8a-1eea67c32106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:02.787624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490966e-fd36-4c84-8a8a-1eea67c32106 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:02.797183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1066/2139] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:02 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:03.386275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5a06a-ba7a-4290-b68e-49d37b1172f8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:03.450126 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5a06a-ba7a-4290-b68e-49d37b1172f8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:03.454794 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:03.455657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:03.455944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:03.456221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] PATH_INFO: `/v3/users/3677b0d7d64e45e0a52c05bd70936dda` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:03.457481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3677b0d7d64e45e0a52c05bd70936dda)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:03.460129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:03.507961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3677b0d7d64e45e0a52c05bd70936dda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:03.516647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3677b0d7d64e45e0a52c05bd70936dda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:03.524343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3677b0d7d64e45e0a52c05bd70936dda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:03.524979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3677b0d7d64e45e0a52c05bd70936dda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:03.536183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3677b0d7d64e45e0a52c05bd70936dda'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:03.542581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1074/2140] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:03 2021] DELETE /identity/v3/users/3677b0d7d64e45e0a52c05bd70936dda => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:03.547031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:03.547493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:03.547580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:03.566482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:03.567729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:03.626016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1067/2141] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:03.636605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:03.638087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:03.693343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8cd0c5-f2a6-44b3-89e0-c4d369ca6e3a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:03.697033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:03.697708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:03.697997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:03.698274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:03.707316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:03.709196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:03.718791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1075/2142] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:49:04.199437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:04.200881 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:04.213027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83258791-f875-40a0-81ee-12d211b80ab3 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:04.217879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:04.218722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:04.219007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:04.219284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] PATH_INFO: `/v3/projects/69986db4b2f0447f867d268295aad735` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:04.220490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69986db4b2f0447f867d268295aad735)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:04.222428 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:04.274253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69986db4b2f0447f867d268295aad735', 'request_id': 'req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.281580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69986db4b2f0447f867d268295aad735', 'request_id': 'req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.288705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69986db4b2f0447f867d268295aad735', 'request_id': 'req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.298687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] The token cache is being invalidate because project 69986db4b2f0447f867d268295aad735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:04.299053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.299703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.301412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1068/2143] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:04 2021] DELETE /identity/v3/projects/69986db4b2f0447f867d268295aad735 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:04.305697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:04.315117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bdb266-7ede-4bda-a5fa-45639aed6844 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:04.372374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:04.373279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:04.373651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:04.373892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] PATH_INFO: `/v3/users/244e4e19917b4372b1be77822bb14d48` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:04.375164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=244e4e19917b4372b1be77822bb14d48)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:04.377197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:04.428451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244e4e19917b4372b1be77822bb14d48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.440302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244e4e19917b4372b1be77822bb14d48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.447405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244e4e19917b4372b1be77822bb14d48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.448068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244e4e19917b4372b1be77822bb14d48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.460290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-5c685c07-f5a9-4685-ad4e-bcd5171bf9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244e4e19917b4372b1be77822bb14d48'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.466701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1076/2144] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:04 2021] DELETE /identity/v3/users/244e4e19917b4372b1be77822bb14d48 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:04.774980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:04.776539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:04.790318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e081b4-46a6-4eb9-8c4a-830ecc50f5b2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:04.853096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:04.854103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:04.854275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:04.854521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] PATH_INFO: `/v3/projects/83de2e4f56a04320bd69383ecc1df707` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:04.855769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83de2e4f56a04320bd69383ecc1df707)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:04.857722 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:04.908064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83de2e4f56a04320bd69383ecc1df707', 'request_id': 'req-af052868-cc36-4e68-b373-5b5aaebc401f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.916961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83de2e4f56a04320bd69383ecc1df707', 'request_id': 'req-af052868-cc36-4e68-b373-5b5aaebc401f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.929139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83de2e4f56a04320bd69383ecc1df707', 'request_id': 'req-af052868-cc36-4e68-b373-5b5aaebc401f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.938262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] The token cache is being invalidate because project 83de2e4f56a04320bd69383ecc1df707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:04.938561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.939267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-af052868-cc36-4e68-b373-5b5aaebc401f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:04.941660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1069/2145] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:04 2021] DELETE /identity/v3/projects/83de2e4f56a04320bd69383ecc1df707 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:04.947506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2b9fb-0e92-4b6e-9538-d33c3778d4d4 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:04.947994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2b9fb-0e92-4b6e-9538-d33c3778d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:04.948347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2b9fb-0e92-4b6e-9538-d33c3778d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:04.968922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-f9c2b9fb-0e92-4b6e-9538-d33c3778d4d4 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:04.970224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-f9c2b9fb-0e92-4b6e-9538-d33c3778d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:05.041911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1077/2146] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:05.045346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666e20-93af-4db9-9036-572a7fc1655c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.045975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666e20-93af-4db9-9036-572a7fc1655c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.046532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666e20-93af-4db9-9036-572a7fc1655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.066347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-49666e20-93af-4db9-9036-572a7fc1655c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:05.068178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-49666e20-93af-4db9-9036-572a7fc1655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:05.076772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1070/2147] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:05.080786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2b9fb-0e92-4b6e-9538-d33c3778d4d4 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:05.098543 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2b9fb-0e92-4b6e-9538-d33c3778d4d4 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:05.103423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:05.104094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.104481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.104627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.105396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:05.105725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:05.107318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:05.121167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1078/2148] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:05.125549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666e20-93af-4db9-9036-572a7fc1655c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:05.135293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666e20-93af-4db9-9036-572a7fc1655c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:05.141027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:05.141741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.142031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.142313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.143075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:05.145132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:05.178642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1071/2149] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:05 2021] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:05.179804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:05.190962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1762a-806c-452c-8822-814f457defb6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:05.261892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:05.262666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.263027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.263378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.264159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:05.266179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:05.288302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1079/2150] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:05 2021] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:05.292291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:05.303819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d333-4ed2-4027-85cc-8738454a93db admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:05.308586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:05.309256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.309577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.309860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.310632 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:05.312233 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:05.324036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1072/2151] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:05.327719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:05.339439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a55c5-5ff3-4f35-83ed-1bb2f55ecf8a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:05.345421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e462e-8cb8-430a-b71b-103985b8d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:05.346118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e462e-8cb8-430a-b71b-103985b8d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.346402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e462e-8cb8-430a-b71b-103985b8d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.346690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e462e-8cb8-430a-b71b-103985b8d9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.347446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e462e-8cb8-430a-b71b-103985b8d9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:05.350381 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e462e-8cb8-430a-b71b-103985b8d9fe admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:05.375567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1080/2152] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:05 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:05.381466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:05.396944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997122b-893f-4289-af08-fa05a5bb0a08 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:05.406181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1ec3-d65d-4495-af8e-415db10d4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:05.407820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1ec3-d65d-4495-af8e-415db10d4ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.408106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1ec3-d65d-4495-af8e-415db10d4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.408384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1ec3-d65d-4495-af8e-415db10d4ebf admin admin] PATH_INFO: `/v3/projects/e1a16b375b034bd793274cfa5e6ef474/users/1aac818d83a248d3a01cfe0b288501f9/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.431057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e1ec3-d65d-4495-af8e-415db10d4ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a16b375b034bd793274cfa5e6ef474, user_id=1aac818d83a248d3a01cfe0b288501f9, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:05.435003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e1ec3-d65d-4495-af8e-415db10d4ebf admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:05.466546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1073/2153] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:05 2021] PUT /identity/v3/projects/e1a16b375b034bd793274cfa5e6ef474/users/1aac818d83a248d3a01cfe0b288501f9/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:05.467809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bdba0-bddd-4b0b-b27c-dffd6463c17e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:05.468293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bdba0-bddd-4b0b-b27c-dffd6463c17e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:05.468426 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bdba0-bddd-4b0b-b27c-dffd6463c17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:05.530559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e20bdba0-bddd-4b0b-b27c-dffd6463c17e None None] MFA Rules not processed for user `1aac818d83a248d3a01cfe0b288501f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:05.538960 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e20bdba0-bddd-4b0b-b27c-dffd6463c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:05.662399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1081/2154] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:05 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:06.833430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:06.833931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:06.834024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:06.887654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] MFA Rules not processed for user `d0a7e5d6194743b8b1e97ab17e15c72f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:06.888894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:06.970585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1074/2155] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:06.981285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:06.981803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:06.987070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:07.033266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] MFA Rules not processed for user `d0a7e5d6194743b8b1e97ab17e15c72f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:07.034597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:07.043343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1082/2156] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:09.220514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:09.222175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:09.324190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d94ee0-b7e5-4b17-b461-2f3fdf07f92a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:09.331707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9d03c-aa63-4e59-87e0-b0197b0ab27e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:09.332362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d03c-aa63-4e59-87e0-b0197b0ab27e service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:09.332644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d03c-aa63-4e59-87e0-b0197b0ab27e service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:09.332917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9d03c-aa63-4e59-87e0-b0197b0ab27e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:09.342208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9d03c-aa63-4e59-87e0-b0197b0ab27e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:09.343791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9d03c-aa63-4e59-87e0-b0197b0ab27e service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:09.353041 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1075/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:09 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:09.986654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:09.988738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:10.069542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf55e1-7786-4d17-bebf-22fc49bc6799 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:10.074148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:10.075021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:10.075308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:10.075622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] PATH_INFO: `/v3/users/042e8ee177034da0ba2dd7d1346fb1ea` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:10.076856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] RBAC: Authorizing `identity:delete_user(user_id=042e8ee177034da0ba2dd7d1346fb1ea)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:10.078827 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:10.127958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042e8ee177034da0ba2dd7d1346fb1ea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.136172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042e8ee177034da0ba2dd7d1346fb1ea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.143387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042e8ee177034da0ba2dd7d1346fb1ea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.144080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042e8ee177034da0ba2dd7d1346fb1ea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.158088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042e8ee177034da0ba2dd7d1346fb1ea'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.164153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1083/2158] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:09 2021] DELETE /identity/v3/users/042e8ee177034da0ba2dd7d1346fb1ea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:10.168903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:10.169237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:10.169607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:10.187114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:10.188319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:10.248746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1076/2159] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:10.259469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:10.261745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:10.329320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb466ba-cd83-4f95-a182-ecd6dc5b557a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:10.333411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:10.334068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:10.334351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:10.334682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:10.344391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:10.345850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:10.355057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1084/2160] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:10.628661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:10.630213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:10.643135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3816-e8b8-42b8-a7bd-a04f8c148886 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:10.647984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:10.648825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:10.651751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:10.652043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] PATH_INFO: `/v3/projects/1fc525734a6e48e98bcf53c93c18227e` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:10.653510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc525734a6e48e98bcf53c93c18227e)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:10.655457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:10.709609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc525734a6e48e98bcf53c93c18227e', 'request_id': 'req-64e6d862-4c4c-4593-91a5-f8d664697195'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.719996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc525734a6e48e98bcf53c93c18227e', 'request_id': 'req-64e6d862-4c4c-4593-91a5-f8d664697195'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.727204 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc525734a6e48e98bcf53c93c18227e', 'request_id': 'req-64e6d862-4c4c-4593-91a5-f8d664697195'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.737298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] The token cache is being invalidate because project 1fc525734a6e48e98bcf53c93c18227e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:10.737631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.738300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.739910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1077/2161] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:10 2021] DELETE /identity/v3/projects/1fc525734a6e48e98bcf53c93c18227e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:10.744539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:10.754899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b206fd4-fdfc-4fa1-b459-6fd3d13a858d service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:10.812045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:10.812911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:10.813199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:10.813504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] PATH_INFO: `/v3/users/06323444c4ae40f591b7e0d7815ea89f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:10.814707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06323444c4ae40f591b7e0d7815ea89f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:10.816634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:10.861988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06323444c4ae40f591b7e0d7815ea89f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.869774 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06323444c4ae40f591b7e0d7815ea89f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.876742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06323444c4ae40f591b7e0d7815ea89f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.877449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06323444c4ae40f591b7e0d7815ea89f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.888850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ca77de83-9f24-4e87-942b-f022f0c66955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06323444c4ae40f591b7e0d7815ea89f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:10.895021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1085/2162] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:10 2021] DELETE /identity/v3/users/06323444c4ae40f591b7e0d7815ea89f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:11.177499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.178956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.194125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6d862-4c4c-4593-91a5-f8d664697195 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.257747 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.258519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.258806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.259090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] PATH_INFO: `/v3/projects/3ea3050e40a84c93ab70f453e60d0b18` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.260337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea3050e40a84c93ab70f453e60d0b18)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.262345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.310223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea3050e40a84c93ab70f453e60d0b18', 'request_id': 'req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:11.316991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea3050e40a84c93ab70f453e60d0b18', 'request_id': 'req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:11.323202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea3050e40a84c93ab70f453e60d0b18', 'request_id': 'req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:11.333463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] The token cache is being invalidate because project 3ea3050e40a84c93ab70f453e60d0b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:11.333746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:11.334372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1dc29c6c-8f88-4ecf-bdec-f1eb018a69a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:11.336411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1078/2163] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:11 2021] DELETE /identity/v3/projects/3ea3050e40a84c93ab70f453e60d0b18 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:11.342761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196d6a8-c3fc-4db6-a781-3f90f971a7b0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.343224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196d6a8-c3fc-4db6-a781-3f90f971a7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.343331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196d6a8-c3fc-4db6-a781-3f90f971a7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.360839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e196d6a8-c3fc-4db6-a781-3f90f971a7b0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.362073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e196d6a8-c3fc-4db6-a781-3f90f971a7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.419319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1086/2164] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.426961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15686b7-9107-4414-92e9-feba6d9e961c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.427261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15686b7-9107-4414-92e9-feba6d9e961c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.427548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15686b7-9107-4414-92e9-feba6d9e961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.445770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f15686b7-9107-4414-92e9-feba6d9e961c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.446967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f15686b7-9107-4414-92e9-feba6d9e961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.454931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1079/2165] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:11.459331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196d6a8-c3fc-4db6-a781-3f90f971a7b0 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.469996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196d6a8-c3fc-4db6-a781-3f90f971a7b0 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.474810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.475287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.475577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.475860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.476628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:11.476939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.478561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.490022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1087/2166] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:11.494637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15686b7-9107-4414-92e9-feba6d9e961c None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.503789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15686b7-9107-4414-92e9-feba6d9e961c None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.509061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.509683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.509968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.510251 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.510949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.512826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.537386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1080/2167] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:11.541510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.551401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15f943-a9b2-4680-bdf3-b29c828e3188 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.606664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.607331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.607622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.607903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.608634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.610587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.628610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1088/2168] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:11.633252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.643200 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912d8b0-4a43-4816-97d7-1e96d06b03a8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.648412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.649058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.649337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.649647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.650377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.651946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.662446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1081/2169] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:11.666854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.676793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7b7a-3bc4-4ff9-b367-0134d38242d9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.681718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f481a-f515-482e-b74f-d59c948f7b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.682405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f481a-f515-482e-b74f-d59c948f7b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.682692 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f481a-f515-482e-b74f-d59c948f7b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.682972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f481a-f515-482e-b74f-d59c948f7b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.683719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f481a-f515-482e-b74f-d59c948f7b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.685350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f481a-f515-482e-b74f-d59c948f7b4c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.696788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1089/2170] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:11.701176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.712782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa97b7-562e-429f-acf2-14987a6fbc76 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.718386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.721216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.721216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.721216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] PATH_INFO: `/v3/projects/3a6c3acefebd4b12acb6be8d01fc2b0f/users/6b910afa43d741dc806085fce3a41a33/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.737562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a6c3acefebd4b12acb6be8d01fc2b0f, user_id=6b910afa43d741dc806085fce3a41a33, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.740238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.753914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1082/2171] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:11 2021] PUT /identity/v3/projects/3a6c3acefebd4b12acb6be8d01fc2b0f/users/6b910afa43d741dc806085fce3a41a33/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:11.765228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69ebf2-8942-4a2d-b7b0-a4bf120b680a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.765556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69ebf2-8942-4a2d-b7b0-a4bf120b680a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.765861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69ebf2-8942-4a2d-b7b0-a4bf120b680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.792488 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ae69ebf2-8942-4a2d-b7b0-a4bf120b680a None None] MFA Rules not processed for user `6b910afa43d741dc806085fce3a41a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:11.793755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ae69ebf2-8942-4a2d-b7b0-a4bf120b680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:11.855891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1090/2172] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:11.860474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.924203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab6383-436c-4183-8dae-7d8d83854d3c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:11.928933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:11.929622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:11.929907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:11.930181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:11.930919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:11.932798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:11.957822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1083/2173] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:11.962513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69ebf2-8942-4a2d-b7b0-a4bf120b680a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:11.973157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69ebf2-8942-4a2d-b7b0-a4bf120b680a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.030665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.031460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.031780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.032066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.032984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.035303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.038698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.041872 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.068898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1091/2174] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:11 2021] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:12.072849 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.082148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64c9e0-428f-4342-b4f0-f0f1429e1e84 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.087388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.088033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.088322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.088605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.089338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.090944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.102500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1092/2175] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:12.106643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.110239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615d23f-d650-4964-abbe-987569fd5d72 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.113942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c767d4a9ad7459880884eb8c546dc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.114589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.114875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.115154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.116205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3489f-b833-4283-91a0-93ffbfa29a28 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.117190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.124329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.125189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.125537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.125821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] PATH_INFO: `/v3/projects/b5546d05f2a74aa3a0395dcd670eb001/users/ca0d9bc370364163b483bbbb4e4e3e24/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.141135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5546d05f2a74aa3a0395dcd670eb001, user_id=ca0d9bc370364163b483bbbb4e4e3e24, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.143810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.157361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1093/2176] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:12 2021] PUT /identity/v3/projects/b5546d05f2a74aa3a0395dcd670eb001/users/ca0d9bc370364163b483bbbb4e4e3e24/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:12.161127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.179871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.181303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.190080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1084/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:12.224459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c1d68-8913-4a6d-8041-d55683ecd5e4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.229206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9cba1-49dd-46b5-804f-6ec1289789d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.229904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9cba1-49dd-46b5-804f-6ec1289789d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.230193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9cba1-49dd-46b5-804f-6ec1289789d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.230502 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9cba1-49dd-46b5-804f-6ec1289789d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.231242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9cba1-49dd-46b5-804f-6ec1289789d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.232829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9cba1-49dd-46b5-804f-6ec1289789d7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.244569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1094/2178] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:12.248803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.261113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b9fe0-586a-4071-b094-37949aa282f3 service glance] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.267451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.268446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.268733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.269009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] PATH_INFO: `/v3/projects/b5546d05f2a74aa3a0395dcd670eb001/users/ca0d9bc370364163b483bbbb4e4e3e24/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.271014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5546d05f2a74aa3a0395dcd670eb001, user_id=ca0d9bc370364163b483bbbb4e4e3e24, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.274724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.286026 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1085/2179] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:12 2021] PUT /identity/v3/projects/b5546d05f2a74aa3a0395dcd670eb001/users/ca0d9bc370364163b483bbbb4e4e3e24/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:12.296212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcde0f-b52d-4944-af15-00c30398cadc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.296430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcde0f-b52d-4944-af15-00c30398cadc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.296625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcde0f-b52d-4944-af15-00c30398cadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.328142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-38fcde0f-b52d-4944-af15-00c30398cadc None None] MFA Rules not processed for user `ca0d9bc370364163b483bbbb4e4e3e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:12.329557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-38fcde0f-b52d-4944-af15-00c30398cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.414528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1095/2180] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:12.424519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.426239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.459264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdcc70-02a5-4d8f-b30b-ec33dbadea9c None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.460140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdcc70-02a5-4d8f-b30b-ec33dbadea9c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.460421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdcc70-02a5-4d8f-b30b-ec33dbadea9c None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.462417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1096/2181] 10.222.0.48 () {54 vars in 912 bytes} [Tue Oct 12 16:49:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 16:49:12.468110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.468399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.468673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.487709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] MFA Rules not processed for user `671f4f6ff7d84739aecf74e53bb1aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:12.489051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.494479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e21b2-655f-451f-b5d6-b35227cef09b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.499342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e49c95-2f4f-4e88-9652-637086fd8ef9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.500207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e49c95-2f4f-4e88-9652-637086fd8ef9 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.500488 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e49c95-2f4f-4e88-9652-637086fd8ef9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.501067 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e49c95-2f4f-4e88-9652-637086fd8ef9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.550233 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1097/2182] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:49:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:12.560347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e49c95-2f4f-4e88-9652-637086fd8ef9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.562705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:12.562837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e49c95-2f4f-4e88-9652-637086fd8ef9 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.564367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:12.577055 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c510-112c-476b-8f99-1d90e2aa5adc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:12.580993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:12.581716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:12.582006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:12.582281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:12.583634 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1086/2183] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:12.592192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:12.593659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:12.602969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1098/2184] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:13.657640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:13.658120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:13.658213 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:13.675944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] MFA Rules not processed for user `d0a7e5d6194743b8b1e97ab17e15c72f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:13.677154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:13.759697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1087/2185] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:17.960704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:17.970428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f0869-fb32-41d6-8070-dc26f3b91957 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:17.974624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cce63-31ee-4e9c-bac8-10663b2f05ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:17.975778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cce63-31ee-4e9c-bac8-10663b2f05ef service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:17.976025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cce63-31ee-4e9c-bac8-10663b2f05ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:17.976303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cce63-31ee-4e9c-bac8-10663b2f05ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:17.985829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cce63-31ee-4e9c-bac8-10663b2f05ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:17.987359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cce63-31ee-4e9c-bac8-10663b2f05ef service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:18.015495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1099/2186] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:17 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:19.451656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:19.453185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:19.528484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312c38c-dac8-4d39-a879-5a6d46d347df None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:19.533320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:19.534378 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:19.534662 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:19.534968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] PATH_INFO: `/v3/users/e3eaf109f6794bb5b46e844193ffb556` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:19.536261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3eaf109f6794bb5b46e844193ffb556)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:19.539109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:19.594202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3eaf109f6794bb5b46e844193ffb556'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:19.594879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3eaf109f6794bb5b46e844193ffb556'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:19.602856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3eaf109f6794bb5b46e844193ffb556'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:19.610755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3eaf109f6794bb5b46e844193ffb556'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:19.612158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3eaf109f6794bb5b46e844193ffb556'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:19.630291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1088/2187] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:19 2021] DELETE /identity/v3/users/e3eaf109f6794bb5b46e844193ffb556 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:19.634803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:19.635264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:19.635487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:19.652529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:19.653787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:19.716507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1100/2188] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:19.726512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:19.728067 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:19.782784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd812317-78eb-4dc4-abe7-86b672cf9a87 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:19.786415 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:19.787050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:19.787360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:19.788177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:19.796888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:19.798335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:19.807607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1089/2189] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:20.080282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:20.081785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:20.097058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1ce63-aa78-4785-889a-bea1a496c932 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:20.114082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:20.115260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:20.116272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:20.116715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] PATH_INFO: `/v3/projects/5ad87ed5fc5c4435912fc02c040e759a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:20.118215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad87ed5fc5c4435912fc02c040e759a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:20.120581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:20.173132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad87ed5fc5c4435912fc02c040e759a', 'request_id': 'req-9cdc3954-21d0-44d9-b227-a75692415700'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.181163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad87ed5fc5c4435912fc02c040e759a', 'request_id': 'req-9cdc3954-21d0-44d9-b227-a75692415700'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.187459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad87ed5fc5c4435912fc02c040e759a', 'request_id': 'req-9cdc3954-21d0-44d9-b227-a75692415700'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.198239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] The token cache is being invalidate because project 5ad87ed5fc5c4435912fc02c040e759a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:20.198625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.199343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9cdc3954-21d0-44d9-b227-a75692415700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:20.200944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1101/2190] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:20 2021] DELETE /identity/v3/projects/5ad87ed5fc5c4435912fc02c040e759a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:22.885479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:22.886864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:22.899068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdefef3-7981-41d7-8ab7-4c9f050d522e service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:22.955469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:22.956257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:22.956540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:22.956818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] PATH_INFO: `/v3/users/6b910afa43d741dc806085fce3a41a33` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:22.958055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b910afa43d741dc806085fce3a41a33)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:22.959952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:23.004280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b910afa43d741dc806085fce3a41a33'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.005643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b910afa43d741dc806085fce3a41a33'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.015625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b910afa43d741dc806085fce3a41a33'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.022820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b910afa43d741dc806085fce3a41a33'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.023477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b910afa43d741dc806085fce3a41a33'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.042122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1090/2191] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:22 2021] DELETE /identity/v3/users/6b910afa43d741dc806085fce3a41a33 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:23.047309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.047821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.048107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.068212 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:23.070023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:23.128246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1102/2192] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:23.138801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:23.140240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:23.209932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faa237-c48f-464a-b947-ea1194f7dc44 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:23.213491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:23.214128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.214410 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.214683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.223569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:23.224976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:23.234508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1091/2193] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:23.517994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:23.519810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:23.534099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78258402-266d-46d4-83e2-b6b903a1559a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:23.542107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:23.543206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.543652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.544083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] PATH_INFO: `/v3/projects/3a6c3acefebd4b12acb6be8d01fc2b0f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.545629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a6c3acefebd4b12acb6be8d01fc2b0f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:23.547939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:23.597052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a6c3acefebd4b12acb6be8d01fc2b0f', 'request_id': 'req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.605246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a6c3acefebd4b12acb6be8d01fc2b0f', 'request_id': 'req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.611726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a6c3acefebd4b12acb6be8d01fc2b0f', 'request_id': 'req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.622448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] The token cache is being invalidate because project 3a6c3acefebd4b12acb6be8d01fc2b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:23.622739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.623421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.624963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1103/2194] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:23 2021] DELETE /identity/v3/projects/3a6c3acefebd4b12acb6be8d01fc2b0f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:23.628865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:23.638240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01293fc0-6b4f-4cf2-b3e4-2eab4ba367fd service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:23.691541 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:23.692396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:23.693082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:23.693362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] PATH_INFO: `/v3/users/ca0d9bc370364163b483bbbb4e4e3e24` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:23.694618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0d9bc370364163b483bbbb4e4e3e24)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:23.696630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:23.747563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0d9bc370364163b483bbbb4e4e3e24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.748216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0d9bc370364163b483bbbb4e4e3e24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.755690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0d9bc370364163b483bbbb4e4e3e24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.762508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0d9bc370364163b483bbbb4e4e3e24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.763128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-824e0403-e17d-4213-b927-7d4a7548d051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0d9bc370364163b483bbbb4e4e3e24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:23.780074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1092/2195] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:23 2021] DELETE /identity/v3/users/ca0d9bc370364163b483bbbb4e4e3e24 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:24.065566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.066993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.082698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9b120-56ad-4b9e-bcae-e8dd3a3907c3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.140480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.141334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.141656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.141936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] PATH_INFO: `/v3/projects/b5546d05f2a74aa3a0395dcd670eb001` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.143139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5546d05f2a74aa3a0395dcd670eb001)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.145042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.191188 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5546d05f2a74aa3a0395dcd670eb001', 'request_id': 'req-03e63065-3e25-4b24-8879-9c98824cafe7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.198847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5546d05f2a74aa3a0395dcd670eb001', 'request_id': 'req-03e63065-3e25-4b24-8879-9c98824cafe7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.205283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5546d05f2a74aa3a0395dcd670eb001', 'request_id': 'req-03e63065-3e25-4b24-8879-9c98824cafe7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.217695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] The token cache is being invalidate because project b5546d05f2a74aa3a0395dcd670eb001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:24.217986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.218978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-03e63065-3e25-4b24-8879-9c98824cafe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:24.220184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1104/2196] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:24 2021] DELETE /identity/v3/projects/b5546d05f2a74aa3a0395dcd670eb001 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:24.227530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893287f-46d1-4dc5-af59-2ef46f010c53 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.228101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893287f-46d1-4dc5-af59-2ef46f010c53 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.228487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893287f-46d1-4dc5-af59-2ef46f010c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.247795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5893287f-46d1-4dc5-af59-2ef46f010c53 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:24.249130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5893287f-46d1-4dc5-af59-2ef46f010c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.309513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1093/2197] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:24.317926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76711984-af15-4c79-871b-650bd83e8006 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.318251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76711984-af15-4c79-871b-650bd83e8006 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.318523 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76711984-af15-4c79-871b-650bd83e8006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.352260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-76711984-af15-4c79-871b-650bd83e8006 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:24.352260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-76711984-af15-4c79-871b-650bd83e8006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.360081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1105/2198] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:24.364284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893287f-46d1-4dc5-af59-2ef46f010c53 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.375243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893287f-46d1-4dc5-af59-2ef46f010c53 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.380184 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.380839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.381129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.382121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.382864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:24.383178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.384791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.398338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1094/2199] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:24.400942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76711984-af15-4c79-871b-650bd83e8006 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.410121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76711984-af15-4c79-871b-650bd83e8006 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.414872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.415510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.415799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.416077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.416775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.418785 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.453035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1106/2200] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:24 2021] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:24.456987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.467059 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9991739-864c-40cf-9a25-8dc9b086aa6d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.522638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.523302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.523586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.523863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.524599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.526521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.546495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1095/2201] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:24 2021] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:24.550809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.561568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfd141-05e3-457a-8bef-6f00df1e5457 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.566091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.566743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.567028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.567313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.568077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.570321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.580430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1107/2202] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:24.584160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.594352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757a20d-028e-4578-a245-36241f781b82 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.598923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b997-41c6-41ff-8a0b-c7ad382303be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.599563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b997-41c6-41ff-8a0b-c7ad382303be admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.599855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b997-41c6-41ff-8a0b-c7ad382303be admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.600669 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b997-41c6-41ff-8a0b-c7ad382303be admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.601462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b997-41c6-41ff-8a0b-c7ad382303be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.603072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8b997-41c6-41ff-8a0b-c7ad382303be admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.612689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1096/2203] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:24.617631 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.627782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ca4d-df61-4d17-b541-10f37a6e1deb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.632354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751474-ca74-4686-b627-277d5616452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.633205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751474-ca74-4686-b627-277d5616452d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.633526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751474-ca74-4686-b627-277d5616452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.633799 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93751474-ca74-4686-b627-277d5616452d admin admin] PATH_INFO: `/v3/projects/0b384ce8437d427ba3af2bcafd1c211b/users/b1617c22ba6b4e5d8a22428a5b594227/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.651446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751474-ca74-4686-b627-277d5616452d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b384ce8437d427ba3af2bcafd1c211b, user_id=b1617c22ba6b4e5d8a22428a5b594227, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.654858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93751474-ca74-4686-b627-277d5616452d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.668415 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1108/2204] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:24 2021] PUT /identity/v3/projects/0b384ce8437d427ba3af2bcafd1c211b/users/b1617c22ba6b4e5d8a22428a5b594227/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:24.673642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac5ba-34dd-41c4-9d53-e421575f5f6e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.673935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac5ba-34dd-41c4-9d53-e421575f5f6e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.674217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac5ba-34dd-41c4-9d53-e421575f5f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.692367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-76bac5ba-34dd-41c4-9d53-e421575f5f6e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:24.693633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-76bac5ba-34dd-41c4-9d53-e421575f5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.755046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1097/2205] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:24.765182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751474-ca74-4686-b627-277d5616452d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:24.767008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-93751474-ca74-4686-b627-277d5616452d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:24.823806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93751474-ca74-4686-b627-277d5616452d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:24.827437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:24.828093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:24.828383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:24.828666 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:24.838147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:24.839716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:24.851043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1109/2206] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:25.485140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69a09f-156e-4316-b7b6-410ff0344a8e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.485612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69a09f-156e-4316-b7b6-410ff0344a8e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.485741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69a09f-156e-4316-b7b6-410ff0344a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.515031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ec69a09f-156e-4316-b7b6-410ff0344a8e None None] MFA Rules not processed for user `b1617c22ba6b4e5d8a22428a5b594227`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:25.516461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ec69a09f-156e-4316-b7b6-410ff0344a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.708272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1098/2207] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:25.720464 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:25.723840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:25.778593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99004f0f-5562-4aef-bbc2-330c299f260a service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:25.782358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:25.783068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:25.783354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:25.783635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:25.792528 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:25.794146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:25.802793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1110/2208] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:25 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:27.130082 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54d976-8863-4125-b491-ba224aad7a2a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:27.130582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54d976-8863-4125-b491-ba224aad7a2a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:27.130676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54d976-8863-4125-b491-ba224aad7a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:27.148748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-fb54d976-8863-4125-b491-ba224aad7a2a None None] MFA Rules not processed for user `b1617c22ba6b4e5d8a22428a5b594227`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:27.150031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fb54d976-8863-4125-b491-ba224aad7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:27.157649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1099/2209] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:27 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:51.300868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.302311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.316718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3d3b-9f55-446f-abcb-2017ad5516ec service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.322162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.323013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.323295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.323569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] PATH_INFO: `/v3/users/5db1cc5ce6bf4dcf93b496d36f931429` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.324741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db1cc5ce6bf4dcf93b496d36f931429)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.326678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.372699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db1cc5ce6bf4dcf93b496d36f931429'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.380158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db1cc5ce6bf4dcf93b496d36f931429'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.387432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db1cc5ce6bf4dcf93b496d36f931429'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.388162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db1cc5ce6bf4dcf93b496d36f931429'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.399475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db1cc5ce6bf4dcf93b496d36f931429'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.405017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1111/2210] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:51 2021] DELETE /identity/v3/users/5db1cc5ce6bf4dcf93b496d36f931429 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:51.409569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.410055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.410158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.427054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:51.428229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.484367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1100/2211] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:51.495245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.496673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.552547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d216d-b03c-4e1a-9dd9-7277ed935048 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.556987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.557882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.558058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.558271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.571271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.572816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.584294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1112/2212] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:51.851298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.853512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.870292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19638b2a-e8d7-4cf5-b7b2-1c8a7ce04ad2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.871733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:51.873028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.873483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:51.874033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.874314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.874752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] PATH_INFO: `/v3/projects/f77362b42a3946d1a1d832d107882917` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.876009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77362b42a3946d1a1d832d107882917)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.877969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.898222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e70871-517f-41f9-aa63-83fc8df15e8f service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:51.904572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:51.905703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:51.906274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:51.906492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] PATH_INFO: `/v3/users/1aac818d83a248d3a01cfe0b288501f9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:51.907988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aac818d83a248d3a01cfe0b288501f9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:51.910548 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:51.934228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77362b42a3946d1a1d832d107882917', 'request_id': 'req-fb41764f-e997-41e6-ad1d-fce054725931'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.944032 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77362b42a3946d1a1d832d107882917', 'request_id': 'req-fb41764f-e997-41e6-ad1d-fce054725931'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.950936 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77362b42a3946d1a1d832d107882917', 'request_id': 'req-fb41764f-e997-41e6-ad1d-fce054725931'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.962719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] The token cache is being invalidate because project f77362b42a3946d1a1d832d107882917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:51.963306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.964547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-fb41764f-e997-41e6-ad1d-fce054725931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.966144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1101/2213] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:51 2021] DELETE /identity/v3/projects/f77362b42a3946d1a1d832d107882917 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:51.973226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aac818d83a248d3a01cfe0b288501f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:51.991691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aac818d83a248d3a01cfe0b288501f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.001936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aac818d83a248d3a01cfe0b288501f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.006428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aac818d83a248d3a01cfe0b288501f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.021605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aac818d83a248d3a01cfe0b288501f9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.030322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1113/2214] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:51 2021] DELETE /identity/v3/users/1aac818d83a248d3a01cfe0b288501f9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:52.035131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.035473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.035719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.059406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:52.061837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:52.133157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1102/2215] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:52.144450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.146002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:52.207193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc49fe-29df-42f4-8ec9-5993eaa15add admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.212047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e828-68dc-401d-b266-54438d38756c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.212722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e828-68dc-401d-b266-54438d38756c service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.213134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e828-68dc-401d-b266-54438d38756c service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.213438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e828-68dc-401d-b266-54438d38756c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.225165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e828-68dc-401d-b266-54438d38756c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.226272 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e828-68dc-401d-b266-54438d38756c service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.236636 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1114/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:52.501818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.503296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:52.516735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e8f58-0cb7-4dea-bb42-7143a7e8824a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.521589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.522437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.522718 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.522991 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] PATH_INFO: `/v3/projects/e1a16b375b034bd793274cfa5e6ef474` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.524858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a16b375b034bd793274cfa5e6ef474)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.526838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.581014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a16b375b034bd793274cfa5e6ef474', 'request_id': 'req-50438121-70b3-4276-ab00-89aec4b88562'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.591326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a16b375b034bd793274cfa5e6ef474', 'request_id': 'req-50438121-70b3-4276-ab00-89aec4b88562'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.597920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a16b375b034bd793274cfa5e6ef474', 'request_id': 'req-50438121-70b3-4276-ab00-89aec4b88562'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.608024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] The token cache is being invalidate because project e1a16b375b034bd793274cfa5e6ef474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:52.608323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.608969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-50438121-70b3-4276-ab00-89aec4b88562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:52.610503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1103/2217] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:52 2021] DELETE /identity/v3/projects/e1a16b375b034bd793274cfa5e6ef474 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:52.616115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f7133-2b51-4a16-91ca-86ea523e2625 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.616582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f7133-2b51-4a16-91ca-86ea523e2625 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.616833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f7133-2b51-4a16-91ca-86ea523e2625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.636560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-902f7133-2b51-4a16-91ca-86ea523e2625 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:52.637916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-902f7133-2b51-4a16-91ca-86ea523e2625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:52.699407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1115/2218] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:52.708092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97acfc5-dc5d-4d4f-ba8f-b86500e3d702 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.708383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97acfc5-dc5d-4d4f-ba8f-b86500e3d702 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.708668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97acfc5-dc5d-4d4f-ba8f-b86500e3d702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.727775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e97acfc5-dc5d-4d4f-ba8f-b86500e3d702 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:52.729047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e97acfc5-dc5d-4d4f-ba8f-b86500e3d702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:52.737826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1104/2219] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:52.742028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f7133-2b51-4a16-91ca-86ea523e2625 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.752461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f7133-2b51-4a16-91ca-86ea523e2625 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.757240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.757982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.758898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.759186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.759932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:52.760252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.761982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.778710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97acfc5-dc5d-4d4f-ba8f-b86500e3d702 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.781497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1116/2220] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:52.787404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97acfc5-dc5d-4d4f-ba8f-b86500e3d702 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.793728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.794412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.794698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.794977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.795703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.797614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.836559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1105/2221] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:52.841128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.856015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41795e83-d7a4-4f56-babb-5b9df8eb0d86 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.914014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.914710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.915003 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.915287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.915993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.917929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.939252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1117/2222] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:52 2021] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:52.943641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.954266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b609c-c9af-42b1-a858-d41d348959da admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.958706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.959348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.959631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.959901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.960633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.962303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:52.972360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1106/2223] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:52.976227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:52.986206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24b829-5541-4b64-a6f3-08d9b8457129 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:52.990986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d565314-2190-42e6-958a-344f4624a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:52.991668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d565314-2190-42e6-958a-344f4624a578 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:52.992192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d565314-2190-42e6-958a-344f4624a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:52.992192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d565314-2190-42e6-958a-344f4624a578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:52.993527 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d565314-2190-42e6-958a-344f4624a578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:52.995111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d565314-2190-42e6-958a-344f4624a578 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.005086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1118/2224] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:53.009786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.019474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3db8b-e519-4d3f-9855-608d1114272c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.024223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.025203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.025384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.025677 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] PATH_INFO: `/v3/projects/1faa44a8ea2f4229b9428afde33bc3af/users/e07221b24dc948f99b6c182c35712859/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.040074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1faa44a8ea2f4229b9428afde33bc3af, user_id=e07221b24dc948f99b6c182c35712859, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.042732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.057643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1107/2225] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:53 2021] PUT /identity/v3/projects/1faa44a8ea2f4229b9428afde33bc3af/users/e07221b24dc948f99b6c182c35712859/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:53.067699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd67e-f4ec-4ace-8069-e4a8b109537b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.067997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd67e-f4ec-4ace-8069-e4a8b109537b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.068284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd67e-f4ec-4ace-8069-e4a8b109537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.099404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2b7cd67e-f4ec-4ace-8069-e4a8b109537b None None] MFA Rules not processed for user `e07221b24dc948f99b6c182c35712859`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:53.100634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2b7cd67e-f4ec-4ace-8069-e4a8b109537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:53.167720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1119/2226] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:53 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:53.178475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.180737 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:53.242946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31103b97-e426-4c5e-96bc-b26dcad049dd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:53.246777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:53.247418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.247703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.247981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.256467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:53.257979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:53.266532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1108/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:53 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:53.335714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc496-fa0b-4b22-b5f0-8a5bb3e497b1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:53.336055 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc496-fa0b-4b22-b5f0-8a5bb3e497b1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:53.336330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dc496-fa0b-4b22-b5f0-8a5bb3e497b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:53.354054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c97dc496-fa0b-4b22-b5f0-8a5bb3e497b1 None None] MFA Rules not processed for user `b1617c22ba6b4e5d8a22428a5b594227`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:53.355242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c97dc496-fa0b-4b22-b5f0-8a5bb3e497b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:53.408165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1120/2228] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:53 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:53.922008 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:53.930684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.003128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24e457-ce0a-44ed-b0ee-e9d577a7ccd4 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.003331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.004136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.004458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.004699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] PATH_INFO: `/v3/users/cf44cc21ba2448899c30684db54cbdff` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.005955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf44cc21ba2448899c30684db54cbdff)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.008516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.059838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf44cc21ba2448899c30684db54cbdff'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.060535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf44cc21ba2448899c30684db54cbdff'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.067349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf44cc21ba2448899c30684db54cbdff'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.074868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf44cc21ba2448899c30684db54cbdff'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.075621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf44cc21ba2448899c30684db54cbdff'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.092772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1109/2229] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:49:53 2021] DELETE /identity/v3/users/cf44cc21ba2448899c30684db54cbdff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:54.097441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.097954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.098141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.116602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:54.118141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.176006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1121/2230] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:49:54.187513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.188929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.251347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c421b-108d-41d2-91e7-4362d145b8c1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.255777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f19347-7193-4064-a598-0b06dbb9ac4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.256606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19347-7193-4064-a598-0b06dbb9ac4a service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.257099 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19347-7193-4064-a598-0b06dbb9ac4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.257567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f19347-7193-4064-a598-0b06dbb9ac4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.268177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f19347-7193-4064-a598-0b06dbb9ac4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.269810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f19347-7193-4064-a598-0b06dbb9ac4a service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.280819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1110/2231] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:49:54.563175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.564652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.577396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9329c-e30e-4b54-8e94-6707e9bba973 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.582196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.583053 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.583513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.583801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] PATH_INFO: `/v3/projects/b6edfc643ede4e04944ab90e751fd7f0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.585012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6edfc643ede4e04944ab90e751fd7f0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.587532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.636425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6edfc643ede4e04944ab90e751fd7f0', 'request_id': 'req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.644345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6edfc643ede4e04944ab90e751fd7f0', 'request_id': 'req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.655484 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6edfc643ede4e04944ab90e751fd7f0', 'request_id': 'req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.662444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] The token cache is being invalidate because project b6edfc643ede4e04944ab90e751fd7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:49:54.662896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.663515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0162b35f-7ac7-4933-97f0-49fe1b0eec9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:49:54.666655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1122/2232] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:49:54 2021] DELETE /identity/v3/projects/b6edfc643ede4e04944ab90e751fd7f0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:49:54.672387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488289a2-b0cb-4397-8a36-d2c204160a90 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.672686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488289a2-b0cb-4397-8a36-d2c204160a90 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.672982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488289a2-b0cb-4397-8a36-d2c204160a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.691753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-488289a2-b0cb-4397-8a36-d2c204160a90 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:54.692945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-488289a2-b0cb-4397-8a36-d2c204160a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.760622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1111/2233] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:54.768677 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a1f3-2cf7-4494-9555-7ecfa1176264 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.769466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a1f3-2cf7-4494-9555-7ecfa1176264 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.769974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7a1f3-2cf7-4494-9555-7ecfa1176264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.793034 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-20e7a1f3-2cf7-4494-9555-7ecfa1176264 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:54.794958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-20e7a1f3-2cf7-4494-9555-7ecfa1176264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:54.805712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1123/2234] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:54.810120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488289a2-b0cb-4397-8a36-d2c204160a90 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.826661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488289a2-b0cb-4397-8a36-d2c204160a90 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.831486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.832141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.832422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.832692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.833461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:49:54.833786 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.835363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.849404 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1112/2235] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:49:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:49:54.854242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7a1f3-2cf7-4494-9555-7ecfa1176264 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.865171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7a1f3-2cf7-4494-9555-7ecfa1176264 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.874406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.875074 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.875361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.875635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:54.876508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:54.878435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:54.907222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1124/2236] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:49:54 2021] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:49:54.911674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:54.922365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ddab6-db06-4aad-8a34-31b08a246256 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:54.998427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:54.999179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:54.999521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:54.999854 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.000618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.002611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.024853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1113/2237] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:49:54 2021] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:49:55.028995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:55.039630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254565fe-8367-4de7-9a06-76a779e3039a admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:55.045305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:55.046027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.046315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.046582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.047398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.049227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.061470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1125/2238] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:49:55.064793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:55.074959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aff2d0-1af0-4821-9e60-a060f8994ca9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:55.079618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0368188-701b-460a-b3ff-87c74e6c6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:55.080258 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368188-701b-460a-b3ff-87c74e6c6f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.080540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368188-701b-460a-b3ff-87c74e6c6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.080813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368188-701b-460a-b3ff-87c74e6c6f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.081573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0368188-701b-460a-b3ff-87c74e6c6f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.083163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0368188-701b-460a-b3ff-87c74e6c6f6d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.092850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1114/2239] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:49:55 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:49:55.096926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:55.106657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddce036-f54a-48d1-b91f-c5d8d8ff9f11 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:55.111800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:55.112798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.113131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.113437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] PATH_INFO: `/v3/projects/80f40741761a4934bb49106299f1d38f/users/c748796b42e346f3aa6eef3c03e94724/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.128141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f40741761a4934bb49106299f1d38f, user_id=c748796b42e346f3aa6eef3c03e94724, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.131005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.144739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1126/2240] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:49:55 2021] PUT /identity/v3/projects/80f40741761a4934bb49106299f1d38f/users/c748796b42e346f3aa6eef3c03e94724/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:49:55.155739 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.156021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.156304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.182725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] MFA Rules not processed for user `c748796b42e346f3aa6eef3c03e94724`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:49:55.183955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:55.251358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1115/2241] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:49:55 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:49:55.264573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:49:55.266327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:49:55.347326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941971e4-92c7-4ffc-acaf-9af24f4c0009 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:49:55.355475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc096b-b7fd-475b-a085-5cacac7a1c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:49:55.358494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc096b-b7fd-475b-a085-5cacac7a1c3a service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:49:55.369561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc096b-b7fd-475b-a085-5cacac7a1c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:49:55.369561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc096b-b7fd-475b-a085-5cacac7a1c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:49:55.382622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc096b-b7fd-475b-a085-5cacac7a1c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:49:55.383724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc096b-b7fd-475b-a085-5cacac7a1c3a service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:49:55.393731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1127/2242] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:49:55 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:06.455627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:06.457491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.526119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f82a65-4e06-4f8e-be67-d0add20e12b4 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:06.531230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:06.532098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.532383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.532662 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] PATH_INFO: `/v3/users/e07221b24dc948f99b6c182c35712859` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.533919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07221b24dc948f99b6c182c35712859)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:06.536012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:06.609171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07221b24dc948f99b6c182c35712859'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.610154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07221b24dc948f99b6c182c35712859'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.618658 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07221b24dc948f99b6c182c35712859'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.625528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07221b24dc948f99b6c182c35712859'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.626185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07221b24dc948f99b6c182c35712859'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:06.644825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1116/2243] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:06 2021] DELETE /identity/v3/users/e07221b24dc948f99b6c182c35712859 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:06.650057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.650646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.650750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.668632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:06.669909 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.730708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1128/2244] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:06.741247 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:06.743027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:06.817287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b08cf4-83cc-416c-9573-ced461337f7f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:06.822697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc75d-d950-48f9-8ddc-1a04cff20ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:06.823407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc75d-d950-48f9-8ddc-1a04cff20ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:06.823697 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc75d-d950-48f9-8ddc-1a04cff20ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:06.824003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc75d-d950-48f9-8ddc-1a04cff20ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:06.835126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc75d-d950-48f9-8ddc-1a04cff20ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:06.837113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc75d-d950-48f9-8ddc-1a04cff20ab9 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:06.851704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1117/2245] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:07.152170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:07.153597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:07.165585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759147f-2920-4a34-9d20-5440f0c139ad None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:07.170550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:07.171397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:07.171680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:07.171955 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] PATH_INFO: `/v3/projects/1faa44a8ea2f4229b9428afde33bc3af` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:07.173156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1faa44a8ea2f4229b9428afde33bc3af)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:07.181054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:07.222058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1faa44a8ea2f4229b9428afde33bc3af', 'request_id': 'req-83a3d06f-5d46-45b2-b90c-0525c3b4a693'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.228859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1faa44a8ea2f4229b9428afde33bc3af', 'request_id': 'req-83a3d06f-5d46-45b2-b90c-0525c3b4a693'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.234993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1faa44a8ea2f4229b9428afde33bc3af', 'request_id': 'req-83a3d06f-5d46-45b2-b90c-0525c3b4a693'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.245296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] The token cache is being invalidate because project 1faa44a8ea2f4229b9428afde33bc3af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:07.245613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.246240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:07.247749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1129/2246] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:07 2021] DELETE /identity/v3/projects/1faa44a8ea2f4229b9428afde33bc3af => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:16.499618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361e15-3f52-4106-9d40-480aeb7c2053 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:16.500097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361e15-3f52-4106-9d40-480aeb7c2053 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:16.500187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24361e15-3f52-4106-9d40-480aeb7c2053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:16.518212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-24361e15-3f52-4106-9d40-480aeb7c2053 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:16.519425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-24361e15-3f52-4106-9d40-480aeb7c2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:16.586118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1118/2247] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:50:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:16.642198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:16.643609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:16.715709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3d06f-5d46-45b2-b90c-0525c3b4a693 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:16.721058 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:16.721735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:16.722028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:16.722311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:16.730890 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:16.732461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:16.740513 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1130/2248] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:50:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:50:23.934852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb46d-f5bd-492c-9e0a-a3039d629403 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:23.935460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb46d-f5bd-492c-9e0a-a3039d629403 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:23.935460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedb46d-f5bd-492c-9e0a-a3039d629403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:23.954462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2aedb46d-f5bd-492c-9e0a-a3039d629403 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:23.959911 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2aedb46d-f5bd-492c-9e0a-a3039d629403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:23.969114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1119/2249] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:50:23 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:23.986756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:23.999903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab12206-064b-463e-b84f-00e1ec2a1b57 service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:24.005601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8b269-78de-48e9-af7c-2a121ac99217 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:24.006343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8b269-78de-48e9-af7c-2a121ac99217 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:24.006706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8b269-78de-48e9-af7c-2a121ac99217 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:24.007063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8b269-78de-48e9-af7c-2a121ac99217 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:24.016601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8b269-78de-48e9-af7c-2a121ac99217 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:24.018406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8b269-78de-48e9-af7c-2a121ac99217 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:24.033763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1131/2250] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:50:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:50:31.686575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ccf7-af9c-49fc-957d-5cb5338050dd None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:31.687266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ccf7-af9c-49fc-957d-5cb5338050dd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:31.687266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9ccf7-af9c-49fc-957d-5cb5338050dd None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:31.689239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1120/2251] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:50:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:50:31.696722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a16c-b923-4a46-aa42-61478b2b02e8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:31.697468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a16c-b923-4a46-aa42-61478b2b02e8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:31.697468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a16c-b923-4a46-aa42-61478b2b02e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:31.734377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2b39a16c-b923-4a46-aa42-61478b2b02e8 None None] MFA Rules not processed for user `da3ce1b443aa425c99aab2ca8e6b53c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:31.736044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2b39a16c-b923-4a46-aa42-61478b2b02e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:31.936519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1132/2252] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:50:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:31.949949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ccf7-af9c-49fc-957d-5cb5338050dd None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:31.960282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2ba9ccf7-af9c-49fc-957d-5cb5338050dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:32.037360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9ccf7-af9c-49fc-957d-5cb5338050dd None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:32.044914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7d3a6-a64c-453f-8caf-7414e706e0b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c767d4a9ad7459880884eb8c546dc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:32.045621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7d3a6-a64c-453f-8caf-7414e706e0b5 service glance] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:32.045935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7d3a6-a64c-453f-8caf-7414e706e0b5 service glance] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:32.046214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7d3a6-a64c-453f-8caf-7414e706e0b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:32.058338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7d3a6-a64c-453f-8caf-7414e706e0b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:32.059822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7d3a6-a64c-453f-8caf-7414e706e0b5 service glance] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:32.077481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1121/2253] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:32.154587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e30d19-b67a-42c4-b3b2-f1667a8c4946 None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:32.154940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e30d19-b67a-42c4-b3b2-f1667a8c4946 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:32.157510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e30d19-b67a-42c4-b3b2-f1667a8c4946 None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:32.159730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1133/2254] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:50:32 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:50:32.166153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6dbd6-7f51-4cc4-bdd1-92847d30fd67 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:32.166437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6dbd6-7f51-4cc4-bdd1-92847d30fd67 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:32.166903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6dbd6-7f51-4cc4-bdd1-92847d30fd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:32.209172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-34b6dbd6-7f51-4cc4-bdd1-92847d30fd67 None None] MFA Rules not processed for user `671f4f6ff7d84739aecf74e53bb1aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:32.210779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-34b6dbd6-7f51-4cc4-bdd1-92847d30fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:32.285070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1122/2255] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:50:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:32.298503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e30d19-b67a-42c4-b3b2-f1667a8c4946 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:32.300409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c5e30d19-b67a-42c4-b3b2-f1667a8c4946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:32.318603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e30d19-b67a-42c4-b3b2-f1667a8c4946 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:32.324103 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:32.326086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:32.326715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:32.327279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:32.339222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:32.341633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:32.353143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1134/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:32 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:35.867092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:35.868081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:35.868367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:35.899941 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:35.902081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:35.928110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1123/2257] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:50:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:35.947858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:35.971530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2463d-2c0d-47bc-837a-85c693653d76 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:35.979889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f45a6-6c53-4a3a-9318-e485b3ea02fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:35.980608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f45a6-6c53-4a3a-9318-e485b3ea02fc service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:35.980895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f45a6-6c53-4a3a-9318-e485b3ea02fc service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:35.981178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f45a6-6c53-4a3a-9318-e485b3ea02fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:35.991015 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f45a6-6c53-4a3a-9318-e485b3ea02fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:35.992629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f45a6-6c53-4a3a-9318-e485b3ea02fc service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:36.008618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1135/2258] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:50:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:50:37.156307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:37.158720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:37.303280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77718477-52b7-40f0-bd80-89d2c2b0cfd4 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:37.308898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:37.309810 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:37.310543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:37.311577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] PATH_INFO: `/v3/users/c748796b42e346f3aa6eef3c03e94724` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:37.314315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c748796b42e346f3aa6eef3c03e94724)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:37.316272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:37.432094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c748796b42e346f3aa6eef3c03e94724'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:37.433175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c748796b42e346f3aa6eef3c03e94724'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:37.458412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c748796b42e346f3aa6eef3c03e94724'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:37.478785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c748796b42e346f3aa6eef3c03e94724'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:37.480252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c748796b42e346f3aa6eef3c03e94724'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:37.521811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1124/2259] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:37 2021] DELETE /identity/v3/users/c748796b42e346f3aa6eef3c03e94724 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:37.523723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:37.524580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:37.525037 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:37.571546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:37.578370 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:37.727039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1136/2260] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:37.746345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:37.747868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:37.861049 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06e946-4a4a-4ee7-9cc7-b55f7c8fdfa8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:37.874511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b43fa-63c2-4df3-950b-f40fc294c74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:37.875484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b43fa-63c2-4df3-950b-f40fc294c74b service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:37.875928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b43fa-63c2-4df3-950b-f40fc294c74b service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:37.876368 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b43fa-63c2-4df3-950b-f40fc294c74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:37.887933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b43fa-63c2-4df3-950b-f40fc294c74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:37.889835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b43fa-63c2-4df3-950b-f40fc294c74b service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:37.902238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1125/2261] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:38.311437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:38.312869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:38.353023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef405555-cc34-48cf-90b5-364529263ce8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:38.370723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:38.371835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:38.372187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:38.372556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] PATH_INFO: `/v3/projects/80f40741761a4934bb49106299f1d38f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:38.375801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f40741761a4934bb49106299f1d38f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:38.389316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:38.508227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f40741761a4934bb49106299f1d38f', 'request_id': 'req-65967cef-81c0-4c75-95b4-ffed844bb080'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.523253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f40741761a4934bb49106299f1d38f', 'request_id': 'req-65967cef-81c0-4c75-95b4-ffed844bb080'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.571866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f40741761a4934bb49106299f1d38f', 'request_id': 'req-65967cef-81c0-4c75-95b4-ffed844bb080'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.584897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] The token cache is being invalidate because project 80f40741761a4934bb49106299f1d38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:38.585256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.586009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-65967cef-81c0-4c75-95b4-ffed844bb080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:38.592436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1137/2262] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:38 2021] DELETE /identity/v3/projects/80f40741761a4934bb49106299f1d38f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:38.594633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f83642-38c5-4e57-a7ca-433296eac453 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:38.595134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f83642-38c5-4e57-a7ca-433296eac453 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:38.595221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f83642-38c5-4e57-a7ca-433296eac453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:38.668646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c8f83642-38c5-4e57-a7ca-433296eac453 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:38.671651 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c8f83642-38c5-4e57-a7ca-433296eac453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:38.790499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1126/2263] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:38.798975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442cf1c-d89e-4157-a307-b4727523d14e None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:38.799274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442cf1c-d89e-4157-a307-b4727523d14e None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:38.799564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442cf1c-d89e-4157-a307-b4727523d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:38.842772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a442cf1c-d89e-4157-a307-b4727523d14e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:38.844596 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a442cf1c-d89e-4157-a307-b4727523d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:38.870656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1138/2264] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:38.872552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f83642-38c5-4e57-a7ca-433296eac453 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:38.889729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f83642-38c5-4e57-a7ca-433296eac453 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:38.895575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:38.896361 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:38.896748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:38.897189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:38.898058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:38.898472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:38.900191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:38.948294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1127/2265] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:38.952988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442cf1c-d89e-4157-a307-b4727523d14e None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:38.963547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442cf1c-d89e-4157-a307-b4727523d14e None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:38.968952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:38.969712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:38.970004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:38.970342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:38.971062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:38.972965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.006246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1139/2266] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:38 2021] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:39.011241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.024694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7350a5-9d23-42b1-a700-f19dcc466cd9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.090407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.091205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.091548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.092144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.092931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.094884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.133984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1128/2267] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:39 2021] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:39.138284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.165092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e578fe5-b10f-48fd-9d4e-82f79a3738a5 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.170761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.171356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.171696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.171984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.172732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.174400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.193929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1140/2268] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:39 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:39.198011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.213598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239b555-d02f-4b0e-93bb-b5c52c3727a7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.220920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a9fff-1355-4141-a632-f9d7e8b93bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.222518 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9fff-1355-4141-a632-f9d7e8b93bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.223051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9fff-1355-4141-a632-f9d7e8b93bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.223498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9fff-1355-4141-a632-f9d7e8b93bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.224422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a9fff-1355-4141-a632-f9d7e8b93bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.226264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a9fff-1355-4141-a632-f9d7e8b93bbc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.239833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1129/2269] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:39 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:39.244356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.261941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e17dca-72b0-4d0d-8716-8c714070a56e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.268353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.269735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.270182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.270633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] PATH_INFO: `/v3/projects/90f576bd4268462bb4d30b20f1fe22a2/users/47869759b68147398e7513ab44ecd5ab/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.290247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f576bd4268462bb4d30b20f1fe22a2, user_id=47869759b68147398e7513ab44ecd5ab, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.293703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.311957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1141/2270] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:39 2021] PUT /identity/v3/projects/90f576bd4268462bb4d30b20f1fe22a2/users/47869759b68147398e7513ab44ecd5ab/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:39.327309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6745-2967-437c-ab50-07506d4e99e1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.327608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6745-2967-437c-ab50-07506d4e99e1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.328038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6745-2967-437c-ab50-07506d4e99e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.387508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a7ac6745-2967-437c-ab50-07506d4e99e1 None None] MFA Rules not processed for user `47869759b68147398e7513ab44ecd5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:39.388676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a7ac6745-2967-437c-ab50-07506d4e99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:39.543929 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1130/2271] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:39 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:39.554499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:39.556514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:39.658112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7482e-bf3b-4cbb-984e-a9c7650dae8c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:39.664578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76445b-29ce-47aa-87d6-b04bec6a3c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:39.665329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76445b-29ce-47aa-87d6-b04bec6a3c06 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:39.665864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76445b-29ce-47aa-87d6-b04bec6a3c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:39.666221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76445b-29ce-47aa-87d6-b04bec6a3c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:39.678299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76445b-29ce-47aa-87d6-b04bec6a3c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:39.680370 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76445b-29ce-47aa-87d6-b04bec6a3c06 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:39.691427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1142/2272] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:39 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:41.226025 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:41.226666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:41.226666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:41.246300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] MFA Rules not processed for user `47869759b68147398e7513ab44ecd5ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:41.247826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:41.257000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1131/2273] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:41 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:43.288913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.289498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.289498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.307763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:43.308999 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:43.363564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1143/2274] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 12 16:50:43 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:43.377238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:43.378611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:43.463844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4304a-f9a6-4dec-b101-0ee652e8627d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:43.470387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:43.471242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:43.471624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:43.472020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:43.481988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:43.483581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:43.496179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1132/2275] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:50:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:50:45.729331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:45.730869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:45.793776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71c8ed-9f99-4ea4-82f7-4b9eb61b446d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:45.798567 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:45.799434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:45.799746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:45.800024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] PATH_INFO: `/v3/users/b1617c22ba6b4e5d8a22428a5b594227` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:45.801233 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1617c22ba6b4e5d8a22428a5b594227)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:45.803187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:45.848122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1617c22ba6b4e5d8a22428a5b594227'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:45.855237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1617c22ba6b4e5d8a22428a5b594227'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:45.861987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1617c22ba6b4e5d8a22428a5b594227'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:45.862656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1617c22ba6b4e5d8a22428a5b594227'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:45.874741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-9198a7ac-b2f7-4d03-a6b7-f16e69e81934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1617c22ba6b4e5d8a22428a5b594227'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:45.880420 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1144/2276] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:45 2021] DELETE /identity/v3/users/b1617c22ba6b4e5d8a22428a5b594227 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:46.164504 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.188639 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb36f2a-429e-461c-a8d6-ed29b00d5286 service swift] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.259108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.259999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.260285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.260565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] PATH_INFO: `/v3/projects/0b384ce8437d427ba3af2bcafd1c211b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.261807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b384ce8437d427ba3af2bcafd1c211b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.263714 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.311029 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b384ce8437d427ba3af2bcafd1c211b', 'request_id': 'req-e6e9c2b1-88ef-4a05-b753-a307f52065de'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:46.318967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b384ce8437d427ba3af2bcafd1c211b', 'request_id': 'req-e6e9c2b1-88ef-4a05-b753-a307f52065de'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:46.325672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b384ce8437d427ba3af2bcafd1c211b', 'request_id': 'req-e6e9c2b1-88ef-4a05-b753-a307f52065de'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:46.336419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] The token cache is being invalidate because project 0b384ce8437d427ba3af2bcafd1c211b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:46.336838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:46.337577 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e6e9c2b1-88ef-4a05-b753-a307f52065de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:46.339175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1133/2277] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:46 2021] DELETE /identity/v3/projects/0b384ce8437d427ba3af2bcafd1c211b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:46.345096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cc0b4-ecef-43d5-923e-58e674f12354 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.345422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cc0b4-ecef-43d5-923e-58e674f12354 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.345715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915cc0b4-ecef-43d5-923e-58e674f12354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.363580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-915cc0b4-ecef-43d5-923e-58e674f12354 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:46.364716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-915cc0b4-ecef-43d5-923e-58e674f12354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:46.437067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1145/2278] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:46.444643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349b1e8-34dc-4115-a303-49747d639733 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.444934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349b1e8-34dc-4115-a303-49747d639733 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.445217 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349b1e8-34dc-4115-a303-49747d639733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.463298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e349b1e8-34dc-4115-a303-49747d639733 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:46.464509 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e349b1e8-34dc-4115-a303-49747d639733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:46.475793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1134/2279] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:46.477061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cc0b4-ecef-43d5-923e-58e674f12354 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.487911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915cc0b4-ecef-43d5-923e-58e674f12354 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.492685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.493352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.494323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.494564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.495309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:46.495783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.497412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.510281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1146/2280] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:50:46.514734 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349b1e8-34dc-4115-a303-49747d639733 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.523828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349b1e8-34dc-4115-a303-49747d639733 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.528558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.529212 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.529532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.529815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.530528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.532420 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.558590 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1135/2281] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:46 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:46.562852 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.572703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438f097-cc1e-4b86-a674-f0dff3224a21 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.628569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.629131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.629449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.629735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.630459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.632354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.652273 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1147/2282] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:46 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:46.656573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.667139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bcb81-80fd-4c36-8c0a-404482341ae0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.672085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.672823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.673109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.673427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.674171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.675790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.686211 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1136/2283] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:46.690244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.700065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef05cd7-4ee7-4da8-8d0f-b275af8476ae admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.704762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004933a-317a-4e0c-a9cb-f9ce1d17b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.705448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004933a-317a-4e0c-a9cb-f9ce1d17b752 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.705742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004933a-317a-4e0c-a9cb-f9ce1d17b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.706022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004933a-317a-4e0c-a9cb-f9ce1d17b752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.706759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004933a-317a-4e0c-a9cb-f9ce1d17b752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.708338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004933a-317a-4e0c-a9cb-f9ce1d17b752 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.719307 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1148/2284] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:46.723421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.733641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c79d4-6e96-42fc-bdd6-bd55ca2d7d30 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.738149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.739003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.739281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.739554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] PATH_INFO: `/v3/projects/03250bd18543443d82783f385393dea0/users/4439e5dfe4904959b07ac9bee0b3b046/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.753435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03250bd18543443d82783f385393dea0, user_id=4439e5dfe4904959b07ac9bee0b3b046, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.756153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.769210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1137/2285] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:46 2021] PUT /identity/v3/projects/03250bd18543443d82783f385393dea0/users/4439e5dfe4904959b07ac9bee0b3b046/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:46.780251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8916-844e-4e6d-b072-4c85b0a4e4d7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.780768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8916-844e-4e6d-b072-4c85b0a4e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.780896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8916-844e-4e6d-b072-4c85b0a4e4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.807267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a24a8916-844e-4e6d-b072-4c85b0a4e4d7 None None] MFA Rules not processed for user `4439e5dfe4904959b07ac9bee0b3b046`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:46.808474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a24a8916-844e-4e6d-b072-4c85b0a4e4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:46.869252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1149/2286] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:46 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:46.879463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:46.881066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:46.948817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d556f-4610-45c9-a367-e5d07db3df13 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:46.952853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc24e44-96cd-48a7-8a43-750b6ba373fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:46.953613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc24e44-96cd-48a7-8a43-750b6ba373fa service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:46.953968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc24e44-96cd-48a7-8a43-750b6ba373fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:46.954350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc24e44-96cd-48a7-8a43-750b6ba373fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:46.965281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc24e44-96cd-48a7-8a43-750b6ba373fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:46.967454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc24e44-96cd-48a7-8a43-750b6ba373fa service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:46.979817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1138/2287] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:47.008167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8916-844e-4e6d-b072-4c85b0a4e4d7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:47.073237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8916-844e-4e6d-b072-4c85b0a4e4d7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:47.077848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:47.078709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:47.078991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:47.079264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] PATH_INFO: `/v3/users/4439e5dfe4904959b07ac9bee0b3b046` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:47.080472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4439e5dfe4904959b07ac9bee0b3b046)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:47.082424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:47.179609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4439e5dfe4904959b07ac9bee0b3b046'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.214398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4439e5dfe4904959b07ac9bee0b3b046'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.223891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4439e5dfe4904959b07ac9bee0b3b046'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.224607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4439e5dfe4904959b07ac9bee0b3b046'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.238550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4439e5dfe4904959b07ac9bee0b3b046'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.249481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1150/2288] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:50:47 2021] DELETE /identity/v3/users/4439e5dfe4904959b07ac9bee0b3b046 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:47.250642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:47.251256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:47.251256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:47.272990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:47.274661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:47.389699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1139/2289] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:47.396236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:47.398179 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:47.478258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46271da-dbc7-4505-9108-ae8c057ec643 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:47.483720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2bd0f-ef63-40a2-9512-83dfdb7b1d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:47.484639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2bd0f-ef63-40a2-9512-83dfdb7b1d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:47.485101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2bd0f-ef63-40a2-9512-83dfdb7b1d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:47.485693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2bd0f-ef63-40a2-9512-83dfdb7b1d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:47.500223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2bd0f-ef63-40a2-9512-83dfdb7b1d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:47.505939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2bd0f-ef63-40a2-9512-83dfdb7b1d01 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:47.522349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1151/2290] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:50:47.847682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:47.850084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:47.871988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6627f-8536-46be-bac5-283f62d7f614 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:47.877921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:47.878803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:47.879158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:47.879531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] PATH_INFO: `/v3/projects/03250bd18543443d82783f385393dea0` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:47.880928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03250bd18543443d82783f385393dea0)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:47.883167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:47.953749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03250bd18543443d82783f385393dea0', 'request_id': 'req-5a6a3e51-acd6-441e-b877-b3c25ed63507'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.964574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03250bd18543443d82783f385393dea0', 'request_id': 'req-5a6a3e51-acd6-441e-b877-b3c25ed63507'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.973435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03250bd18543443d82783f385393dea0', 'request_id': 'req-5a6a3e51-acd6-441e-b877-b3c25ed63507'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.985147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] The token cache is being invalidate because project 03250bd18543443d82783f385393dea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:50:47.985486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.986155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5a6a3e51-acd6-441e-b877-b3c25ed63507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:50:47.987948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1140/2291] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:50:47 2021] DELETE /identity/v3/projects/03250bd18543443d82783f385393dea0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:47.994686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d473-e16e-452b-8acf-3fe97c8f12a7 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:47.995298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d473-e16e-452b-8acf-3fe97c8f12a7 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:47.995298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8d473-e16e-452b-8acf-3fe97c8f12a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.046901 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b8a8d473-e16e-452b-8acf-3fe97c8f12a7 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:48.049413 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b8a8d473-e16e-452b-8acf-3fe97c8f12a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:48.125332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1152/2292] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:48.133424 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f444-3ab8-45c7-b50f-c254aecf277d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.134048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f444-3ab8-45c7-b50f-c254aecf277d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.134360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8f444-3ab8-45c7-b50f-c254aecf277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.152812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-28b8f444-3ab8-45c7-b50f-c254aecf277d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:48.154050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-28b8f444-3ab8-45c7-b50f-c254aecf277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:48.161960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1141/2293] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:50:48.167106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8d473-e16e-452b-8acf-3fe97c8f12a7 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.181393 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8d473-e16e-452b-8acf-3fe97c8f12a7 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.186008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.186693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.186979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.187259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.188183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:50:48.188504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.190344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.204900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1153/2294] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:50:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:50:48.209090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8f444-3ab8-45c7-b50f-c254aecf277d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.220529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8f444-3ab8-45c7-b50f-c254aecf277d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.226930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.227654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.227973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.229019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.229609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.231544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.264650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1142/2295] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:48 2021] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:48.265855 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.276705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5efd5-889d-40ba-bf01-df6596cff47f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.337973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.338673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.338957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.339235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.339943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.342134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.363974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1154/2296] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:48 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:48.367905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.378056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed39a53-9617-4072-a115-bb7a7f66d926 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.382914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.383582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.383867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.384154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.384902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.386602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.398366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1143/2297] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:48.403803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.417189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7265c3-8006-40dc-81f0-13ec29b9a5e8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.430551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1a66e-8a2c-4a2d-89f1-5ccc34492e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.432811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1a66e-8a2c-4a2d-89f1-5ccc34492e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.432811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1a66e-8a2c-4a2d-89f1-5ccc34492e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.432811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1a66e-8a2c-4a2d-89f1-5ccc34492e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.432811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1a66e-8a2c-4a2d-89f1-5ccc34492e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.440698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1a66e-8a2c-4a2d-89f1-5ccc34492e1f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.461183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1155/2298] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:48 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:48.465791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.487833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef341ee-ee35-4dbd-a94e-7d3eed628386 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.502491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.503490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.503845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.504207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] PATH_INFO: `/v3/projects/6b276008196643ce9a2938b78207fc0c/users/b1a7fa4717c9404c9c5933e4f025ee2e/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.527496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b276008196643ce9a2938b78207fc0c, user_id=b1a7fa4717c9404c9c5933e4f025ee2e, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.530292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.549839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1144/2299] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:48 2021] PUT /identity/v3/projects/6b276008196643ce9a2938b78207fc0c/users/b1a7fa4717c9404c9c5933e4f025ee2e/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:48.551078 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa7d7c-d9de-4f2b-93be-6402487a04e9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.551379 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa7d7c-d9de-4f2b-93be-6402487a04e9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.551668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa7d7c-d9de-4f2b-93be-6402487a04e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.582809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8aaa7d7c-d9de-4f2b-93be-6402487a04e9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:48.591434 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8aaa7d7c-d9de-4f2b-93be-6402487a04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:48.666214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1156/2300] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:48.673024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:48.675399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:48.753727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c124ed2-f214-47f4-931f-f99446330456 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:48.757735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:48.758390 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:48.758680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:48.758949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:48.769314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:48.771076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:48.782411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1145/2301] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:50:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:50:54.622558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2dbe-0036-4185-8e7e-5417efc53ceb None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:54.623463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2dbe-0036-4185-8e7e-5417efc53ceb None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:54.623752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d2dbe-0036-4185-8e7e-5417efc53ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:54.667512 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d53d2dbe-0036-4185-8e7e-5417efc53ceb None None] MFA Rules not processed for user `b1a7fa4717c9404c9c5933e4f025ee2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:50:54.672033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d53d2dbe-0036-4185-8e7e-5417efc53ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:50:54.770454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1157/2302] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:50:54 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:50:54.775387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:54.804609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c03fd3-9dc5-42e9-af4b-7ac89d80126b service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:54.814842 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:54.815803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:54.816541 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:54.816830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:54.817673 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:54.819896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:54.875618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1146/2303] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:50:54 2021] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:50:54.880455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2dbe-0036-4185-8e7e-5417efc53ceb None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:54.896289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d2dbe-0036-4185-8e7e-5417efc53ceb None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:54.984608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:54.985318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:54.985822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:54.986122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:54.986977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:54.988922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:55.019906 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1158/2304] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:50:54 2021] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:50:55.024072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:55.038167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe46847-c77c-4e09-84aa-0fb9d2b8e834 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:55.044930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:55.045705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:55.045996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:55.046272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:55.047043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:55.048690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:55.062602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1147/2305] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:55 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:50:55.067386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:55.083626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16512bd8-813a-41e8-94fd-3bd4ca5128b9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:55.091526 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:55.093872 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:55.094391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:55.095385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] PATH_INFO: `/v3/projects/684877887e9549cda1aae83d0cd767c3/users/14007fa59e434d4d886486eae323e900/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:55.122932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684877887e9549cda1aae83d0cd767c3, user_id=14007fa59e434d4d886486eae323e900, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:55.125820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:55.145037 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1159/2306] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:55 2021] PUT /identity/v3/projects/684877887e9549cda1aae83d0cd767c3/users/14007fa59e434d4d886486eae323e900/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:50:55.148913 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:55.160739 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d6d4a-b32a-41e8-aee5-1a25581145d0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:55.236476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83443828-26d5-422a-a75e-cd3db7c06398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:55.237202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83443828-26d5-422a-a75e-cd3db7c06398 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:55.237528 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83443828-26d5-422a-a75e-cd3db7c06398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:55.237865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83443828-26d5-422a-a75e-cd3db7c06398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:55.238622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83443828-26d5-422a-a75e-cd3db7c06398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:55.240257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83443828-26d5-422a-a75e-cd3db7c06398 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:55.251564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1148/2307] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:50:55 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:50:55.255839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:50:55.268998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6891045-44d9-4392-b7ee-ab8ee0fe81e9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:50:55.274969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:50:55.276466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:50:55.276761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:50:55.277079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] PATH_INFO: `/v3/projects/684877887e9549cda1aae83d0cd767c3/users/14007fa59e434d4d886486eae323e900/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:50:55.279191 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684877887e9549cda1aae83d0cd767c3, user_id=14007fa59e434d4d886486eae323e900, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:50:55.281940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:50:55.293069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1160/2308] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:50:55 2021] PUT /identity/v3/projects/684877887e9549cda1aae83d0cd767c3/users/14007fa59e434d4d886486eae323e900/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:51:01.156853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03929fc6-8594-4b8c-b95f-0c42dbf72544 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:01.157463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03929fc6-8594-4b8c-b95f-0c42dbf72544 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:01.157463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03929fc6-8594-4b8c-b95f-0c42dbf72544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:01.212183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-03929fc6-8594-4b8c-b95f-0c42dbf72544 None None] MFA Rules not processed for user `14007fa59e434d4d886486eae323e900`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:01.213892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-03929fc6-8594-4b8c-b95f-0c42dbf72544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:01.309571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1149/2309] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:01 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:01.329640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:01.332602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:01.434842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec640fe-42ae-44a4-9afe-7dedb040d217 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:01.438970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c767d4a9ad7459880884eb8c546dc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:01.439734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:01.440245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:01.440540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:01.535347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:01.537208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:01.554438 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1161/2310] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:01 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:01.695536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29a241-25bf-46a2-afe6-edd515e245ad None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:01.695869 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29a241-25bf-46a2-afe6-edd515e245ad None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:01.696187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29a241-25bf-46a2-afe6-edd515e245ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:01.731949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3d29a241-25bf-46a2-afe6-edd515e245ad None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:01.733284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3d29a241-25bf-46a2-afe6-edd515e245ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:01.799087 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1150/2311] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:51:01 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:01.813678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:01.815145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:01.919270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a075e-8823-4897-b420-5b3f03285f9e service glance] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:01.924823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:01.925565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:01.925860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:01.926143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:01.935057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:01.936698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:01.945892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1162/2312] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:51:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:51:05.935288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bc7f1-7ce2-4ef0-ab2d-1e6340817262 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:05.936580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bc7f1-7ce2-4ef0-ab2d-1e6340817262 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:05.937071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9bc7f1-7ce2-4ef0-ab2d-1e6340817262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:05.971458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ec9bc7f1-7ce2-4ef0-ab2d-1e6340817262 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:05.973042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ec9bc7f1-7ce2-4ef0-ab2d-1e6340817262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:05.982850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1151/2313] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 12 16:51:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:06.002300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:06.014151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef422731-09c9-409b-b709-622ac28c7729 service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:06.019728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:06.023331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:06.023639 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:06.023926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:06.033682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:06.035316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:06.045845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1163/2314] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:51:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:51:09.633171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508bebc-2dc0-4499-aaa2-924d6ff91313 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:09.633811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508bebc-2dc0-4499-aaa2-924d6ff91313 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:09.633811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508bebc-2dc0-4499-aaa2-924d6ff91313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:09.654784 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-a508bebc-2dc0-4499-aaa2-924d6ff91313 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:09.661766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a508bebc-2dc0-4499-aaa2-924d6ff91313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:09.670967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1152/2315] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:51:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:09.698055 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:09.711360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88676267-8dbf-4be7-b7b3-1d205437fffe service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:09.717408 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:09.718184 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:09.718465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:09.718914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:09.735611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:09.738946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:09.756367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1164/2316] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:51:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:51:10.596648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a3252-a8c5-497c-8e81-5725e2457f02 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:10.596945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a3252-a8c5-497c-8e81-5725e2457f02 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:10.597228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a3252-a8c5-497c-8e81-5725e2457f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:10.620132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ca1a3252-a8c5-497c-8e81-5725e2457f02 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:10.621364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ca1a3252-a8c5-497c-8e81-5725e2457f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:10.628997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1153/2317] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:51:10 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:10.644854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:10.659220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ea5c6-1b31-4d01-a776-f60bd86ec419 service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:10.666376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:10.667019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:10.667316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:10.667714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:10.686282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:10.687866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:10.700306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1165/2318] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:51:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:51:11.088785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b477-f911-4b62-9d39-4f0a2de0b6d1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:11.089319 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b477-f911-4b62-9d39-4f0a2de0b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:11.089629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b477-f911-4b62-9d39-4f0a2de0b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:11.112226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5dc7b477-f911-4b62-9d39-4f0a2de0b6d1 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:11.113501 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5dc7b477-f911-4b62-9d39-4f0a2de0b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:11.122748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1154/2319] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 12 16:51:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:11.137148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:11.151424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a91a77-a946-4d57-b390-2b4953ccbb4f service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:11.158981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:11.159755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:11.160107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:11.160618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:11.171010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:11.172766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:11.182989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1166/2320] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:51:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:51:12.396789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0e8c-3a60-431e-abe4-518740e9bffe None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:12.397473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0e8c-3a60-431e-abe4-518740e9bffe None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:12.397473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0e8c-3a60-431e-abe4-518740e9bffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:12.418126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-31ab0e8c-3a60-431e-abe4-518740e9bffe None None] MFA Rules not processed for user `b1a7fa4717c9404c9c5933e4f025ee2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:12.419305 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-31ab0e8c-3a60-431e-abe4-518740e9bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:12.426324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1155/2321] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:12 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:13.368205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:13.369703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:13.438588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace71b-5db5-4d81-b890-16d9d2325ff4 service swift] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:13.443326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:13.444199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:13.444486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:13.444763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] PATH_INFO: `/v3/users/47869759b68147398e7513ab44ecd5ab` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:13.446582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47869759b68147398e7513ab44ecd5ab)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:13.448663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:13.505644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47869759b68147398e7513ab44ecd5ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:13.513519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47869759b68147398e7513ab44ecd5ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:13.520803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47869759b68147398e7513ab44ecd5ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:13.521491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47869759b68147398e7513ab44ecd5ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:13.534787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47869759b68147398e7513ab44ecd5ab'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:13.541573 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1167/2322] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:51:13 2021] DELETE /identity/v3/users/47869759b68147398e7513ab44ecd5ab => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:51:13.546090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:13.547894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:13.547894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:13.565887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:13.567084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:13.628626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1156/2323] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:13.639470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:13.640927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:13.700925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1a5a9-4f3a-406a-9490-5458bebaea27 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:13.704678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13851640-c1e5-4437-8b2e-e7cd988e5305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:13.705326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13851640-c1e5-4437-8b2e-e7cd988e5305 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:13.705649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13851640-c1e5-4437-8b2e-e7cd988e5305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:13.705936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13851640-c1e5-4437-8b2e-e7cd988e5305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:13.715700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13851640-c1e5-4437-8b2e-e7cd988e5305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:13.717483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13851640-c1e5-4437-8b2e-e7cd988e5305 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:13.727012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1168/2324] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:13.903990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:13.905514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:13.920007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c09b1-e6a6-434d-9ad3-92e39d786a09 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:13.929183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:13.930550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:13.930905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:13.931384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] PATH_INFO: `/v3/projects/90f576bd4268462bb4d30b20f1fe22a2` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:13.932847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f576bd4268462bb4d30b20f1fe22a2)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:13.934767 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:13.983653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f576bd4268462bb4d30b20f1fe22a2', 'request_id': 'req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:13.992346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f576bd4268462bb4d30b20f1fe22a2', 'request_id': 'req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:13.999453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f576bd4268462bb4d30b20f1fe22a2', 'request_id': 'req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:14.013864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] The token cache is being invalidate because project 90f576bd4268462bb4d30b20f1fe22a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:51:14.013864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:14.014413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-85fa52f1-b9d5-4c7c-86bd-eeaa940edcb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:14.016284 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1157/2325] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:51:13 2021] DELETE /identity/v3/projects/90f576bd4268462bb4d30b20f1fe22a2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:51:14.025052 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89df0-2961-402e-9b81-17565febcd92 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.025349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89df0-2961-402e-9b81-17565febcd92 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.025665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89df0-2961-402e-9b81-17565febcd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.058803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-12d89df0-2961-402e-9b81-17565febcd92 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:14.061044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-12d89df0-2961-402e-9b81-17565febcd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:14.141576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1169/2326] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:14.150647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7737f-f89a-40f5-a623-88603f358e82 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.151066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7737f-f89a-40f5-a623-88603f358e82 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.151498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7737f-f89a-40f5-a623-88603f358e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.170360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d2d7737f-f89a-40f5-a623-88603f358e82 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:14.173694 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d2d7737f-f89a-40f5-a623-88603f358e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:14.189568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1158/2327] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:14.190478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d89df0-2961-402e-9b81-17565febcd92 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.204047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d89df0-2961-402e-9b81-17565febcd92 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.209962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.210637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.210918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.211194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.212549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:51:14.212861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.215492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.232275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1170/2328] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:51:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:51:14.237122 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7737f-f89a-40f5-a623-88603f358e82 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.247355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7737f-f89a-40f5-a623-88603f358e82 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.253046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.253836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.254182 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.254706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.255574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.257961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.289837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1159/2329] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:51:14 2021] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:51:14.294246 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.304756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdef82b-a0f7-47e8-8626-a673b32ba509 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.386341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.387039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.387291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.387572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.388416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.390419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.411760 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1171/2330] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:51:14 2021] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:51:14.417567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.428450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18df1f-4513-45df-ab13-ed89a5c2b6b4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.435556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06194a9-cc45-4e53-8497-d3af4555f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.436249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06194a9-cc45-4e53-8497-d3af4555f99c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.436538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06194a9-cc45-4e53-8497-d3af4555f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.436818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06194a9-cc45-4e53-8497-d3af4555f99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.437667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06194a9-cc45-4e53-8497-d3af4555f99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.439606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06194a9-cc45-4e53-8497-d3af4555f99c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.464046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1160/2331] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:51:14 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:51:14.464650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.473219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.474264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.474425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.476954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b296f-3fff-4fa4-b9e1-47a2e0dc3b24 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.483608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.484377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.484874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.485183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.487509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.489127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.500961 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1172/2332] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:51:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:51:14.506471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.509821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:14.509821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:14.519068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f7f9-bfee-4842-8f08-77fe6f17eb5b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.524707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95b63e-cc5d-4294-8055-6872f3e76aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.525764 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b63e-cc5d-4294-8055-6872f3e76aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.526306 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b63e-cc5d-4294-8055-6872f3e76aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.526672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95b63e-cc5d-4294-8055-6872f3e76aca admin admin] PATH_INFO: `/v3/projects/1502fa11ca2c4a5a85bccc1a86753f79/users/448bef4f026a442bac8da96cf42b5290/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.546538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b63e-cc5d-4294-8055-6872f3e76aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1502fa11ca2c4a5a85bccc1a86753f79, user_id=448bef4f026a442bac8da96cf42b5290, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.549402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95b63e-cc5d-4294-8055-6872f3e76aca admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.569783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1173/2333] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:51:14 2021] PUT /identity/v3/projects/1502fa11ca2c4a5a85bccc1a86753f79/users/448bef4f026a442bac8da96cf42b5290/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:51:14.579309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1161/2334] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:51:14 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:14.582447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.582912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.583345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.600337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.602303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:14.619745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] MFA Rules not processed for user `448bef4f026a442bac8da96cf42b5290`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:14.622461 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:14.701794 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c16a0d-dab4-4e90-96f8-6d346e85a963 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.723676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1174/2335] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:14 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:51:14.731843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:14.734088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:14.798845 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a2926-0bbc-4eb4-a2a3-63b66d701cfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.799964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2926-0bbc-4eb4-a2a3-63b66d701cfb service swift] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.800475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2926-0bbc-4eb4-a2a3-63b66d701cfb service swift] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.801248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2926-0bbc-4eb4-a2a3-63b66d701cfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.822988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1099c03-9af0-4a0d-9e10-f0fe814c3aba None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:14.828751 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:14.829949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:14.830243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:14.830531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:14.845996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.847690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.876496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1175/2336] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:14 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:51:14.917950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2926-0bbc-4eb4-a2a3-63b66d701cfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:14.921022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2926-0bbc-4eb4-a2a3-63b66d701cfb service swift] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:14.952967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1162/2337] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:51:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 16:51:23.327467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:23.407079 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c158-0781-43b6-b395-9a9b2433b4b0 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:23.411761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:23.412650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:23.412938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:23.413217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] PATH_INFO: `/v3/users/448bef4f026a442bac8da96cf42b5290` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:23.414670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448bef4f026a442bac8da96cf42b5290)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:23.417396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:23.471114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448bef4f026a442bac8da96cf42b5290'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:23.482334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448bef4f026a442bac8da96cf42b5290'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:23.495471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448bef4f026a442bac8da96cf42b5290'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:23.496297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448bef4f026a442bac8da96cf42b5290'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:23.510448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448bef4f026a442bac8da96cf42b5290'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:23.516946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1176/2338] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:51:23 2021] DELETE /identity/v3/users/448bef4f026a442bac8da96cf42b5290 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:51:23.521613 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:23.522429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:23.522429 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:23.541192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:23.542584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:23.613953 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1163/2339] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:51:23.625638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:23.629426 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:23.691410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b827f8-57fc-4203-b11f-e811765458d3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:23.695313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:23.696497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:23.696987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:23.697268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:23.707374 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:23.708879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:23.723579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1177/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:24.074222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:24.075799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:24.099513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409a1b1-77e3-4729-ace2-ee0bbe6d654e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:24.115958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:24.117115 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:24.118532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:24.119267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] PATH_INFO: `/v3/projects/1502fa11ca2c4a5a85bccc1a86753f79` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:24.122530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1502fa11ca2c4a5a85bccc1a86753f79)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:24.125167 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:24.206483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1502fa11ca2c4a5a85bccc1a86753f79', 'request_id': 'req-830d43c1-5708-4a78-90a3-6f84e2ea4320'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:24.218891 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1502fa11ca2c4a5a85bccc1a86753f79', 'request_id': 'req-830d43c1-5708-4a78-90a3-6f84e2ea4320'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:24.230000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1502fa11ca2c4a5a85bccc1a86753f79', 'request_id': 'req-830d43c1-5708-4a78-90a3-6f84e2ea4320'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:24.246618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] The token cache is being invalidate because project 1502fa11ca2c4a5a85bccc1a86753f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:51:24.248067 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:24.249464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:51:24.257636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1164/2341] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:51:24 2021] DELETE /identity/v3/projects/1502fa11ca2c4a5a85bccc1a86753f79 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:51:27.049445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:27.050864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:27.158730 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adf6f0-772d-43e0-bba1-464f25917d18 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:27.224251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03166d1-c3b3-484a-b039-579771ca1643 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:27.225149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03166d1-c3b3-484a-b039-579771ca1643 service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:27.225300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03166d1-c3b3-484a-b039-579771ca1643 service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:27.225534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03166d1-c3b3-484a-b039-579771ca1643 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:27.227943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a03166d1-c3b3-484a-b039-579771ca1643 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:27.239972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03166d1-c3b3-484a-b039-579771ca1643 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:27.241927 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03166d1-c3b3-484a-b039-579771ca1643 service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:27.252862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1178/2342] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:51:43.412535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:51:43.414061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:43.475333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d43c1-5708-4a78-90a3-6f84e2ea4320 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:51:43.478886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:51:43.479790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:43.480170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:43.480451 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:43.482277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:43.554160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:51:43.555600 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:51:43.568263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1165/2343] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:51:43 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:51:59.722606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77621cc-d7bb-4b26-bb23-131de2360f67 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:51:59.723162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77621cc-d7bb-4b26-bb23-131de2360f67 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:51:59.723162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77621cc-d7bb-4b26-bb23-131de2360f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:51:59.740805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b77621cc-d7bb-4b26-bb23-131de2360f67 None None] MFA Rules not processed for user `80558ff481cc4871b5f3f361c42edd17`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:51:59.742038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b77621cc-d7bb-4b26-bb23-131de2360f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:51:59.797177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1179/2344] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:51:59 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:03.826620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:03.828707 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:03.911034 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e56ef6-36a1-4808-bca8-5c8711a25e2b service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:03.916949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:03.917902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:03.918245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:03.919653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] PATH_INFO: `/v3/users/d0a7e5d6194743b8b1e97ab17e15c72f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:03.919955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a7e5d6194743b8b1e97ab17e15c72f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:03.921938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:03.986269 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a7e5d6194743b8b1e97ab17e15c72f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:03.986986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a7e5d6194743b8b1e97ab17e15c72f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.003337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a7e5d6194743b8b1e97ab17e15c72f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.015479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a7e5d6194743b8b1e97ab17e15c72f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.016231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-38af0f03-1825-4292-a88d-067d85f5ebfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a7e5d6194743b8b1e97ab17e15c72f'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.045591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1166/2345] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:03 2021] DELETE /identity/v3/users/d0a7e5d6194743b8b1e97ab17e15c72f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:04.237984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77621cc-d7bb-4b26-bb23-131de2360f67 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.252083 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77621cc-d7bb-4b26-bb23-131de2360f67 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:04.324632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:04.326054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.326339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.326625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] PATH_INFO: `/v3/projects/fcc08699515f48a08c8ac1507eec9cae` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.327868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc08699515f48a08c8ac1507eec9cae)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:04.329844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:04.376534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc08699515f48a08c8ac1507eec9cae', 'request_id': 'req-bdbac977-5460-42d9-980e-deaf46b3e680'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.385109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc08699515f48a08c8ac1507eec9cae', 'request_id': 'req-bdbac977-5460-42d9-980e-deaf46b3e680'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.392242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc08699515f48a08c8ac1507eec9cae', 'request_id': 'req-bdbac977-5460-42d9-980e-deaf46b3e680'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.411210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] The token cache is being invalidate because project fcc08699515f48a08c8ac1507eec9cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:04.411504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.412170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-bdbac977-5460-42d9-980e-deaf46b3e680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:04.413741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1180/2346] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:04 2021] DELETE /identity/v3/projects/fcc08699515f48a08c8ac1507eec9cae => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:04.420394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d849f87-8d6e-4aed-b3e0-0d6eefded45b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.420690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d849f87-8d6e-4aed-b3e0-0d6eefded45b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.420978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d849f87-8d6e-4aed-b3e0-0d6eefded45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.439154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0d849f87-8d6e-4aed-b3e0-0d6eefded45b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:04.440372 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0d849f87-8d6e-4aed-b3e0-0d6eefded45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:04.498346 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1167/2347] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:04.506722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab4100-2295-4d5a-8d60-7a53b87d94a2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.507104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab4100-2295-4d5a-8d60-7a53b87d94a2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.507388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab4100-2295-4d5a-8d60-7a53b87d94a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.526381 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-acab4100-2295-4d5a-8d60-7a53b87d94a2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:04.527584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-acab4100-2295-4d5a-8d60-7a53b87d94a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:04.535424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1181/2348] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:04.539772 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d849f87-8d6e-4aed-b3e0-0d6eefded45b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.549301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d849f87-8d6e-4aed-b3e0-0d6eefded45b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:04.553927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:04.554576 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.554864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.555145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.555880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:04.556191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:04.557821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:04.569811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1168/2349] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:52:04.574217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab4100-2295-4d5a-8d60-7a53b87d94a2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.583820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab4100-2295-4d5a-8d60-7a53b87d94a2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:04.588644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:04.589295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.589613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.589895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.590601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:04.592741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:04.625878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1182/2350] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:04 2021] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:04.630061 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.640422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991b434-e334-4646-bf3b-8856c2dff8c8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:04.698910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:04.699578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.699867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.700815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.701579 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:04.703506 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:04.724236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1169/2351] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:04 2021] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:04.728433 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.739525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37549acd-feac-42f3-b4dd-d5887a3b03ab admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:04.744331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:04.744994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.745287 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.745618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.746358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:04.748004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:04.758787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1183/2352] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:04.762766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.772670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad930a-e81b-42a6-b316-f9b2e99afd9f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:04.777225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3f999-ea07-4d1a-8f74-8f6269047d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:04.777914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3f999-ea07-4d1a-8f74-8f6269047d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.778750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3f999-ea07-4d1a-8f74-8f6269047d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.779031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3f999-ea07-4d1a-8f74-8f6269047d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.779769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3f999-ea07-4d1a-8f74-8f6269047d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:04.781593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3f999-ea07-4d1a-8f74-8f6269047d8f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:04.791798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1170/2353] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:04.798351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.808704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c806-dec2-411e-a579-3f83ccc6cac3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:04.813477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:04.814361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.814815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.815276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] PATH_INFO: `/v3/projects/cd1aa19d8caf459e9d2410492c9728e8/users/9e70302a4412430498391a3bd86b94d9/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.831897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1aa19d8caf459e9d2410492c9728e8, user_id=9e70302a4412430498391a3bd86b94d9, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:04.834630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:04.849010 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1184/2354] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:04 2021] PUT /identity/v3/projects/cd1aa19d8caf459e9d2410492c9728e8/users/9e70302a4412430498391a3bd86b94d9/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:04.858923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e183-e69d-4eb2-9e0c-597a820be22e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:04.859785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e183-e69d-4eb2-9e0c-597a820be22e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:04.860255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1e183-e69d-4eb2-9e0c-597a820be22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:04.893863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8eb1e183-e69d-4eb2-9e0c-597a820be22e None None] MFA Rules not processed for user `9e70302a4412430498391a3bd86b94d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:04.895964 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8eb1e183-e69d-4eb2-9e0c-597a820be22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:04.973612 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1171/2355] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:04 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:04.984826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:04.986566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:05.086193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3177aa-fe4d-4617-987d-70b3df5c6f93 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:05.092814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cd83d-28f6-46cf-944a-39280e9f45db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:05.093520 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cd83d-28f6-46cf-944a-39280e9f45db service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:05.093815 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cd83d-28f6-46cf-944a-39280e9f45db service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:05.094095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cd83d-28f6-46cf-944a-39280e9f45db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:05.102657 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cd83d-28f6-46cf-944a-39280e9f45db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:05.104256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cd83d-28f6-46cf-944a-39280e9f45db service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:05.113219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1185/2356] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:04 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:07.775096 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1e183-e69d-4eb2-9e0c-597a820be22e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:07.840173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1e183-e69d-4eb2-9e0c-597a820be22e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:07.845641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:07.846510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:07.846795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:07.847077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] PATH_INFO: `/v3/users/9e70302a4412430498391a3bd86b94d9` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:07.848311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e70302a4412430498391a3bd86b94d9)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:07.850279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:07.896754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e70302a4412430498391a3bd86b94d9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:07.897431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e70302a4412430498391a3bd86b94d9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:07.905051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e70302a4412430498391a3bd86b94d9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:07.911878 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e70302a4412430498391a3bd86b94d9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:07.912533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e70302a4412430498391a3bd86b94d9'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:07.929460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1172/2357] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:07 2021] DELETE /identity/v3/users/9e70302a4412430498391a3bd86b94d9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:07.934012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:07.934736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:07.934736 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:07.955983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:07.957404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.017888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1186/2358] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:08.027863 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.029925 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.088472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa006b-3a2c-4875-b7f9-13471a533868 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.092983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2d15-7049-4790-9907-da2e2bb1df42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.093665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2d15-7049-4790-9907-da2e2bb1df42 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.093955 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2d15-7049-4790-9907-da2e2bb1df42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.094236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2d15-7049-4790-9907-da2e2bb1df42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.103790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d2d15-7049-4790-9907-da2e2bb1df42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.105248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d2d15-7049-4790-9907-da2e2bb1df42 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.115536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1173/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:08.394803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.396602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.414832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbebb5f-dc4b-45e0-b8cc-42dc5135b985 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.419757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.420621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.420940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.421228 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] PATH_INFO: `/v3/projects/cd1aa19d8caf459e9d2410492c9728e8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.422477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1aa19d8caf459e9d2410492c9728e8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.424383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.473807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1aa19d8caf459e9d2410492c9728e8', 'request_id': 'req-da59014a-184a-4f9e-9f94-0347a22f6f0d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.481971 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1aa19d8caf459e9d2410492c9728e8', 'request_id': 'req-da59014a-184a-4f9e-9f94-0347a22f6f0d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.488957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1aa19d8caf459e9d2410492c9728e8', 'request_id': 'req-da59014a-184a-4f9e-9f94-0347a22f6f0d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.499934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] The token cache is being invalidate because project cd1aa19d8caf459e9d2410492c9728e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:08.500227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.500887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-da59014a-184a-4f9e-9f94-0347a22f6f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:08.502514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1187/2360] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:08 2021] DELETE /identity/v3/projects/cd1aa19d8caf459e9d2410492c9728e8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:08.508551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394fd8-a490-44ef-b7a3-512a2b418f1f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.508840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394fd8-a490-44ef-b7a3-512a2b418f1f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.509119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a394fd8-a490-44ef-b7a3-512a2b418f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.527491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9a394fd8-a490-44ef-b7a3-512a2b418f1f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:08.528724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9a394fd8-a490-44ef-b7a3-512a2b418f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.588938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1174/2361] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:08.596935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb143aa-0515-49bf-a540-273721c31d1d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.597229 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb143aa-0515-49bf-a540-273721c31d1d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.597555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb143aa-0515-49bf-a540-273721c31d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.616383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-aeb143aa-0515-49bf-a540-273721c31d1d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:08.617781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-aeb143aa-0515-49bf-a540-273721c31d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:08.626267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1188/2362] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:08.630907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a394fd8-a490-44ef-b7a3-512a2b418f1f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.641105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a394fd8-a490-44ef-b7a3-512a2b418f1f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.645857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.646531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.646812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.647084 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.647830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:08.648136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.649769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.661649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1175/2363] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:52:08.666213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb143aa-0515-49bf-a540-273721c31d1d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.675908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb143aa-0515-49bf-a540-273721c31d1d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.680649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.681305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.681628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.681909 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.682615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.684503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.715297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1189/2364] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:08.719954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.729809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcaa5e-f8bf-40b9-9566-a2fe13d32908 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.787264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.787938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.788201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.788480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.789201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.791131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.812963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1176/2365] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:08.818267 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.828915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1561-316d-42d8-b42d-da5480330125 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.833970 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.834340 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.834605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.834887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.835635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.837242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.848611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1190/2366] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:08.853607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.868830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c186c-895c-4aeb-8b2f-34a816b7b2b0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.874503 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd6d9f-d8c0-4a46-88ee-4afe8abfd414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.875176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6d9f-d8c0-4a46-88ee-4afe8abfd414 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.875455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6d9f-d8c0-4a46-88ee-4afe8abfd414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.875756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6d9f-d8c0-4a46-88ee-4afe8abfd414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.876511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd6d9f-d8c0-4a46-88ee-4afe8abfd414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.878135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd6d9f-d8c0-4a46-88ee-4afe8abfd414 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.894256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1177/2367] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:08 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:52:08.898344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:08.911388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f83b2-8d79-4412-8f1a-9aab89cd7cd6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:08.918607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:08.920674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.921175 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.921714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] PATH_INFO: `/v3/projects/203fc8c3076d416bbfe79d76a479ef8a/users/5d824f97034c4060bd919daedc3dc630/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:08.945997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203fc8c3076d416bbfe79d76a479ef8a, user_id=5d824f97034c4060bd919daedc3dc630, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:08.950497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:08.965387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1191/2368] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:08 2021] PUT /identity/v3/projects/203fc8c3076d416bbfe79d76a479ef8a/users/5d824f97034c4060bd919daedc3dc630/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:08.977770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff58fd-0b62-435d-b928-ea159bbbd963 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:08.978062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff58fd-0b62-435d-b928-ea159bbbd963 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:08.978343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff58fd-0b62-435d-b928-ea159bbbd963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.010473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-64ff58fd-0b62-435d-b928-ea159bbbd963 None None] MFA Rules not processed for user `5d824f97034c4060bd919daedc3dc630`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:09.011695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-64ff58fd-0b62-435d-b928-ea159bbbd963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.105205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1178/2369] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:08 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:09.106419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.177591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb8bc4-f77b-42d9-a972-9748f20b7980 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.182423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.183090 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.183372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.183647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.184355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.186403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.218862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1192/2370] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:09.219426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff58fd-0b62-435d-b928-ea159bbbd963 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.230688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff58fd-0b62-435d-b928-ea159bbbd963 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.302485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.303160 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.303449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.303729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.304433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.306395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.327706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1179/2371] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:52:09.331656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.343139 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f08167-5c56-4302-a74e-84b39631420b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.348162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.348836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.349131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.349445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.350195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.351791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.363161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1193/2372] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:09.367540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.377924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239d2a3-abcf-4c27-82c1-fefcda42b211 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.382843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.383776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.384065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.384376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] PATH_INFO: `/v3/projects/406f47e80a2d4f5a8077ca022fa4e44f/users/a6992741253c4c9e98a7c2e6bc5448e0/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.402229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406f47e80a2d4f5a8077ca022fa4e44f, user_id=a6992741253c4c9e98a7c2e6bc5448e0, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.405654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.421326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1180/2373] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:09 2021] PUT /identity/v3/projects/406f47e80a2d4f5a8077ca022fa4e44f/users/a6992741253c4c9e98a7c2e6bc5448e0/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:52:09.425290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.435428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de572a-1d2c-47b1-b648-fc1d2dc118f2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.495765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b1f3e-b317-4c23-9168-4329f054ca33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.496588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1f3e-b317-4c23-9168-4329f054ca33 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.496883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1f3e-b317-4c23-9168-4329f054ca33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.497282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1f3e-b317-4c23-9168-4329f054ca33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.497996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b1f3e-b317-4c23-9168-4329f054ca33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.499595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b1f3e-b317-4c23-9168-4329f054ca33 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.509662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1194/2374] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:09.514297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.524596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b825341-3dd4-47d1-9d3d-304cb5d72978 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.530387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.531267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.531547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.531826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] PATH_INFO: `/v3/projects/406f47e80a2d4f5a8077ca022fa4e44f/users/a6992741253c4c9e98a7c2e6bc5448e0/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.533875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406f47e80a2d4f5a8077ca022fa4e44f, user_id=a6992741253c4c9e98a7c2e6bc5448e0, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.536493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.547180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1181/2375] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:09 2021] PUT /identity/v3/projects/406f47e80a2d4f5a8077ca022fa4e44f/users/a6992741253c4c9e98a7c2e6bc5448e0/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:09.557444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec2b15-a5be-4a47-8556-c50096ba1f19 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.557739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec2b15-a5be-4a47-8556-c50096ba1f19 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.558019 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec2b15-a5be-4a47-8556-c50096ba1f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.585734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-98ec2b15-a5be-4a47-8556-c50096ba1f19 None None] MFA Rules not processed for user `a6992741253c4c9e98a7c2e6bc5448e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:09.587109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-98ec2b15-a5be-4a47-8556-c50096ba1f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.654837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1195/2376] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:09 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:09.664811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:09.666671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:09.721323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb14dc-3d5f-476f-baec-ff8958a33030 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:09.724946 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8246e06-4525-425c-b01c-509f10156016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:09.725618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246e06-4525-425c-b01c-509f10156016 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:09.725907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246e06-4525-425c-b01c-509f10156016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:09.726185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8246e06-4525-425c-b01c-509f10156016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:09.734909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8246e06-4525-425c-b01c-509f10156016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:09.736345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8246e06-4525-425c-b01c-509f10156016 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:09.745646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1182/2377] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:09 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:11.048080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec2b15-a5be-4a47-8556-c50096ba1f19 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:11.112114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec2b15-a5be-4a47-8556-c50096ba1f19 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:11.117000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:11.117900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.118210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.118489 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] PATH_INFO: `/v3/users/5d824f97034c4060bd919daedc3dc630` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.119694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d824f97034c4060bd919daedc3dc630)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:11.121885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:11.168465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d824f97034c4060bd919daedc3dc630'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.177130 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d824f97034c4060bd919daedc3dc630'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.184072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d824f97034c4060bd919daedc3dc630'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.185357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d824f97034c4060bd919daedc3dc630'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.197658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d824f97034c4060bd919daedc3dc630'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.204318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1196/2378] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:11 2021] DELETE /identity/v3/users/5d824f97034c4060bd919daedc3dc630 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:11.208969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.209513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.209629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.227088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:11.228277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:11.289774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1183/2379] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:11.299967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:11.301503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:11.358067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474787ca-2770-4029-832a-fa2b6d479235 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:11.361790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:11.362440 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.362725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.363091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.373412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:11.375591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:11.387187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1197/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:11.697467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:11.699040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:11.711889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009faf3-d8e6-4803-82de-42ec3a02351b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:11.722342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:11.725052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.725550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.726033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] PATH_INFO: `/v3/projects/203fc8c3076d416bbfe79d76a479ef8a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.727775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203fc8c3076d416bbfe79d76a479ef8a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:11.730220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:11.790051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203fc8c3076d416bbfe79d76a479ef8a', 'request_id': 'req-29e129e1-2f35-4d29-ae86-63a26ced01f0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.798690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203fc8c3076d416bbfe79d76a479ef8a', 'request_id': 'req-29e129e1-2f35-4d29-ae86-63a26ced01f0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.805682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203fc8c3076d416bbfe79d76a479ef8a', 'request_id': 'req-29e129e1-2f35-4d29-ae86-63a26ced01f0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.816780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] The token cache is being invalidate because project 203fc8c3076d416bbfe79d76a479ef8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:11.817074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.817820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.819417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1184/2381] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:11 2021] DELETE /identity/v3/projects/203fc8c3076d416bbfe79d76a479ef8a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:11.823399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:11.833039 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3c791-784c-47d1-81d8-33502f473537 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:11.891994 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:11.892870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:11.893157 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:11.893487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] PATH_INFO: `/v3/users/a6992741253c4c9e98a7c2e6bc5448e0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:11.894848 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6992741253c4c9e98a7c2e6bc5448e0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:11.896770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:11.958258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6992741253c4c9e98a7c2e6bc5448e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.969356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6992741253c4c9e98a7c2e6bc5448e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.978720 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6992741253c4c9e98a7c2e6bc5448e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.979580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6992741253c4c9e98a7c2e6bc5448e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:11.993688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4123509a-b1e0-4c2f-82d3-90e4c89e1d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6992741253c4c9e98a7c2e6bc5448e0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:12.000945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1198/2382] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:11 2021] DELETE /identity/v3/users/a6992741253c4c9e98a7c2e6bc5448e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:52:12.293573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:12.295756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:12.309660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e129e1-2f35-4d29-ae86-63a26ced01f0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:12.374833 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:12.375602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.376293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.376573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] PATH_INFO: `/v3/projects/406f47e80a2d4f5a8077ca022fa4e44f` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.377868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406f47e80a2d4f5a8077ca022fa4e44f)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:12.379819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:12.427198 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406f47e80a2d4f5a8077ca022fa4e44f', 'request_id': 'req-230589df-1c74-45d0-bb23-ae1707da8799'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:12.434906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406f47e80a2d4f5a8077ca022fa4e44f', 'request_id': 'req-230589df-1c74-45d0-bb23-ae1707da8799'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:12.441516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406f47e80a2d4f5a8077ca022fa4e44f', 'request_id': 'req-230589df-1c74-45d0-bb23-ae1707da8799'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:12.452523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] The token cache is being invalidate because project 406f47e80a2d4f5a8077ca022fa4e44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:12.452850 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:12.453507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-230589df-1c74-45d0-bb23-ae1707da8799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:12.455095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1185/2383] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:12 2021] DELETE /identity/v3/projects/406f47e80a2d4f5a8077ca022fa4e44f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:12.461145 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63bc82-52d5-4331-bbc0-61c934a47432 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.461842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63bc82-52d5-4331-bbc0-61c934a47432 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.462095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63bc82-52d5-4331-bbc0-61c934a47432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.481595 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4c63bc82-52d5-4331-bbc0-61c934a47432 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:12.482840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4c63bc82-52d5-4331-bbc0-61c934a47432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:12.551716 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1199/2384] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:12.559617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869a13-3faf-4275-be85-b0749d93612f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.559931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869a13-3faf-4275-be85-b0749d93612f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.560209 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869a13-3faf-4275-be85-b0749d93612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.579972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-5c869a13-3faf-4275-be85-b0749d93612f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:12.581244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5c869a13-3faf-4275-be85-b0749d93612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:12.593502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1186/2385] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:12.594678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63bc82-52d5-4331-bbc0-61c934a47432 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:12.604268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63bc82-52d5-4331-bbc0-61c934a47432 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:12.608977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:12.609806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.610098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.610380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.611126 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:12.611440 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:12.613067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:12.628796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1200/2386] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:52:12.629986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869a13-3faf-4275-be85-b0749d93612f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:12.640012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869a13-3faf-4275-be85-b0749d93612f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:12.645324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:12.646381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.646712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.647115 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.647839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:12.649828 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:12.686947 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1187/2387] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:12 2021] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:52:12.688274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:12.698443 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb5bc4-80d9-45c9-a1f4-22c9484cf223 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:12.760143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:12.761159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.761625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.762129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.763789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:12.765952 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:12.787207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1201/2388] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:12 2021] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:12.791761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:12.803893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98252027-a24a-45d1-889a-92b6cee33407 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:12.808883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:12.810295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.810598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.810884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.811643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:12.813264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:12.824752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1188/2389] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:12 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:12.829427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:12.840025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ae7a-94f5-4fdf-bacb-33db00a94d72 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:12.845382 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da68b4b-8a62-4fd5-bcda-fa4d1c355c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:12.846264 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68b4b-8a62-4fd5-bcda-fa4d1c355c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.846378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68b4b-8a62-4fd5-bcda-fa4d1c355c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.846629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da68b4b-8a62-4fd5-bcda-fa4d1c355c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.847698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68b4b-8a62-4fd5-bcda-fa4d1c355c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:12.849216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da68b4b-8a62-4fd5-bcda-fa4d1c355c26 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:12.867571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1202/2390] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:12 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:12.868484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:12.880240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58993683-7adc-41ef-9a79-109be0026451 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:12.888905 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:12.889744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.890102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.890560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] PATH_INFO: `/v3/projects/b51ee51ac1f04f83a88fb14b6752b4bd/users/659e95c87d434e608d6d2710c12367c8/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.906237 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51ee51ac1f04f83a88fb14b6752b4bd, user_id=659e95c87d434e608d6d2710c12367c8, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:12.908937 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:12.933254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1189/2391] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:12 2021] PUT /identity/v3/projects/b51ee51ac1f04f83a88fb14b6752b4bd/users/659e95c87d434e608d6d2710c12367c8/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:52:12.940089 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026f8e-40a8-42f7-a7ee-954cc50a399f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:12.940388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026f8e-40a8-42f7-a7ee-954cc50a399f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:12.940673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f026f8e-40a8-42f7-a7ee-954cc50a399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:12.971445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4f026f8e-40a8-42f7-a7ee-954cc50a399f None None] MFA Rules not processed for user `659e95c87d434e608d6d2710c12367c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:12.972951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4f026f8e-40a8-42f7-a7ee-954cc50a399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:13.059544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1203/2392] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:12 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:13.071950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:13.073992 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:13.139236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5357-c62f-4d49-b613-3cf2ddd713a3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:13.143277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e0a7-5a84-45fc-9b44-e149c7d4a637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:13.144185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e0a7-5a84-45fc-9b44-e149c7d4a637 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:13.144594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e0a7-5a84-45fc-9b44-e149c7d4a637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:13.144950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e0a7-5a84-45fc-9b44-e149c7d4a637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:13.154065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e0a7-5a84-45fc-9b44-e149c7d4a637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:13.155602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e0a7-5a84-45fc-9b44-e149c7d4a637 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:13.166110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1190/2393] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:13 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:21.586845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f026f8e-40a8-42f7-a7ee-954cc50a399f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:21.646208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f026f8e-40a8-42f7-a7ee-954cc50a399f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:21.650725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:21.651577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:21.651863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:21.652141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] PATH_INFO: `/v3/users/659e95c87d434e608d6d2710c12367c8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:21.653316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=659e95c87d434e608d6d2710c12367c8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:21.655783 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:21.699569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659e95c87d434e608d6d2710c12367c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:21.706167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659e95c87d434e608d6d2710c12367c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:21.713105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659e95c87d434e608d6d2710c12367c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:21.713777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659e95c87d434e608d6d2710c12367c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:21.725688 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659e95c87d434e608d6d2710c12367c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:21.731222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1204/2394] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:21 2021] DELETE /identity/v3/users/659e95c87d434e608d6d2710c12367c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:21.736425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:21.736900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:21.737013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:21.753312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:21.754567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:21.809743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1191/2395] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:21.819604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:21.821038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:21.877182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1ed4-3841-45bf-9692-9ee37ce2e6c9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:21.880854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de3153-f747-456b-a526-c4f4cc61acbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:21.881549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3153-f747-456b-a526-c4f4cc61acbf service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:21.881837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3153-f747-456b-a526-c4f4cc61acbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:21.882115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de3153-f747-456b-a526-c4f4cc61acbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:21.891258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de3153-f747-456b-a526-c4f4cc61acbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:21.892699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de3153-f747-456b-a526-c4f4cc61acbf service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:21.902018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1205/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:22.159785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.161333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:22.173986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cfc47-6b12-4384-bc64-f0990e898072 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.178800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.179649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.179928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.180195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] PATH_INFO: `/v3/projects/b51ee51ac1f04f83a88fb14b6752b4bd` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.181478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51ee51ac1f04f83a88fb14b6752b4bd)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.183388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.228898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51ee51ac1f04f83a88fb14b6752b4bd', 'request_id': 'req-c57db6cc-efa2-4a94-b962-7f12d300a261'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:22.236145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51ee51ac1f04f83a88fb14b6752b4bd', 'request_id': 'req-c57db6cc-efa2-4a94-b962-7f12d300a261'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:22.242106 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51ee51ac1f04f83a88fb14b6752b4bd', 'request_id': 'req-c57db6cc-efa2-4a94-b962-7f12d300a261'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:22.251841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] The token cache is being invalidate because project b51ee51ac1f04f83a88fb14b6752b4bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:22.252126 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:22.252743 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-c57db6cc-efa2-4a94-b962-7f12d300a261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:22.254987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1192/2397] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:22 2021] DELETE /identity/v3/projects/b51ee51ac1f04f83a88fb14b6752b4bd => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:22.260732 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28e4a-9359-431b-b0a0-a6518945ab0f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.261030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28e4a-9359-431b-b0a0-a6518945ab0f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.261303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc28e4a-9359-431b-b0a0-a6518945ab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.278995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0bc28e4a-9359-431b-b0a0-a6518945ab0f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:22.280803 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0bc28e4a-9359-431b-b0a0-a6518945ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:22.335581 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1206/2398] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:22.344219 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfe24-68b7-478c-be36-e10849c0d6a8 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.344559 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfe24-68b7-478c-be36-e10849c0d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.344842 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfe24-68b7-478c-be36-e10849c0d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.362624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-4f8dfe24-68b7-478c-be36-e10849c0d6a8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:22.363805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4f8dfe24-68b7-478c-be36-e10849c0d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:22.371790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1193/2399] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:22.376214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc28e4a-9359-431b-b0a0-a6518945ab0f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.385510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc28e4a-9359-431b-b0a0-a6518945ab0f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.390646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.391286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.391568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.391843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.392562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:22.392871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.394486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.405462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1207/2400] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:52:22.409655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dfe24-68b7-478c-be36-e10849c0d6a8 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.418591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dfe24-68b7-478c-be36-e10849c0d6a8 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.423249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.423886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.424174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.424455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.425144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.427089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.452387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1194/2401] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:22 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:22.456481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.466138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4b715-6856-447e-9a87-ce7de8987008 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.519460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.520109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.520398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.520680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.521410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.523300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.541934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1208/2402] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:22 2021] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:52:22.545954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.555884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7a3b1-9be3-4e8b-b6e5-ba4bdcad5063 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.560527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.561776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.562058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.562329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.563111 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.564680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.574867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1195/2403] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:22.579301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.588988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d359a8f-3124-4475-91bb-9c5db9700273 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.593829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aaa55-f581-4496-b5d9-1813a9e67948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.594471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aaa55-f581-4496-b5d9-1813a9e67948 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.594759 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aaa55-f581-4496-b5d9-1813a9e67948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.595042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aaa55-f581-4496-b5d9-1813a9e67948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.595767 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aaa55-f581-4496-b5d9-1813a9e67948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.597334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aaa55-f581-4496-b5d9-1813a9e67948 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.606864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1209/2404] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:22 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:22.610780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.620214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff760897-74f9-40b1-befd-8aad8261c2f6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.625310 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.626272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.626576 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.626836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] PATH_INFO: `/v3/projects/99df1513187c40baa3fcbd2a745d039c/users/07981a8bd9984a7cafa0fadf64f60a5b/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.641105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99df1513187c40baa3fcbd2a745d039c, user_id=07981a8bd9984a7cafa0fadf64f60a5b, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.643779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.655966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1196/2405] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:22 2021] PUT /identity/v3/projects/99df1513187c40baa3fcbd2a745d039c/users/07981a8bd9984a7cafa0fadf64f60a5b/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:22.667068 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96315-ea81-4d04-b6a6-12753805be23 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.667469 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96315-ea81-4d04-b6a6-12753805be23 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.667755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96315-ea81-4d04-b6a6-12753805be23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.693932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fbe96315-ea81-4d04-b6a6-12753805be23 None None] MFA Rules not processed for user `07981a8bd9984a7cafa0fadf64f60a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:22.695133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fbe96315-ea81-4d04-b6a6-12753805be23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:22.758591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1210/2406] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:22 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:22.769570 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:22.771303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:22.826532 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50316f-ca57-4906-8522-55f57969405f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:22.830236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:22.830871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:22.831156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:22.831436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:22.839554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:22.840928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:22.849689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1197/2407] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:22 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:37.042773 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4975-8c63-4758-8d1e-7312547f795c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:37.043279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4975-8c63-4758-8d1e-7312547f795c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:37.043382 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd4975-8c63-4758-8d1e-7312547f795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:37.060765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1efd4975-8c63-4758-8d1e-7312547f795c None None] MFA Rules not processed for user `6363ee6ea7c441ccbd9d8dc5ab30cebe`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:37.061982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1efd4975-8c63-4758-8d1e-7312547f795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:37.117165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1211/2408] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:37 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:43.337858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:43.396761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08f6ee-8085-4e43-89ad-ea397f7ab524 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:43.401230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:43.402109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:43.402393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:43.402684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] PATH_INFO: `/v3/users/07981a8bd9984a7cafa0fadf64f60a5b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:43.403864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07981a8bd9984a7cafa0fadf64f60a5b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:43.406311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:43.450736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07981a8bd9984a7cafa0fadf64f60a5b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:43.451402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07981a8bd9984a7cafa0fadf64f60a5b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:43.459684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07981a8bd9984a7cafa0fadf64f60a5b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:43.467232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07981a8bd9984a7cafa0fadf64f60a5b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:43.467621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07981a8bd9984a7cafa0fadf64f60a5b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:43.488606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1198/2409] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:43 2021] DELETE /identity/v3/users/07981a8bd9984a7cafa0fadf64f60a5b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:43.494371 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:43.494877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:43.495334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:43.516188 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:43.517566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:43.580368 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1212/2410] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:52:43.590103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:43.592257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:43.648116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1c1ff-e096-4004-9e8a-d1efc033cb85 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:43.651829 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88cae-25b2-4f0f-9f5d-b3e96ea10cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:43.652489 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88cae-25b2-4f0f-9f5d-b3e96ea10cde service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:43.652776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88cae-25b2-4f0f-9f5d-b3e96ea10cde service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:43.653055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88cae-25b2-4f0f-9f5d-b3e96ea10cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:43.662497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a88cae-25b2-4f0f-9f5d-b3e96ea10cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:43.663923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a88cae-25b2-4f0f-9f5d-b3e96ea10cde service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:43.673761 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1199/2411] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:43.928648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:43.930087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:43.944594 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d17dd9-ee34-4ecf-ae9a-038af2510232 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:43.949428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:43.950753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:43.951486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:43.952285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] PATH_INFO: `/v3/projects/99df1513187c40baa3fcbd2a745d039c` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:43.953894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99df1513187c40baa3fcbd2a745d039c)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:43.955802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.001839 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99df1513187c40baa3fcbd2a745d039c', 'request_id': 'req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:44.010659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99df1513187c40baa3fcbd2a745d039c', 'request_id': 'req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:44.017755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99df1513187c40baa3fcbd2a745d039c', 'request_id': 'req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:44.027765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] The token cache is being invalidate because project 99df1513187c40baa3fcbd2a745d039c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:44.028055 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:44.028706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-614a1bd9-26aa-4ac5-9bf9-6c23f86be3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:44.030845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1213/2412] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:43 2021] DELETE /identity/v3/projects/99df1513187c40baa3fcbd2a745d039c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:44.036343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5989afe-fe24-42e4-9e98-495eba672974 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.036638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5989afe-fe24-42e4-9e98-495eba672974 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.036920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5989afe-fe24-42e4-9e98-495eba672974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.056216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e5989afe-fe24-42e4-9e98-495eba672974 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:44.057561 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e5989afe-fe24-42e4-9e98-495eba672974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:44.120190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1200/2413] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:44.128814 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8cab1-f0c9-4bb5-b1ae-685e5eb7301b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.129147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8cab1-f0c9-4bb5-b1ae-685e5eb7301b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.129409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8cab1-f0c9-4bb5-b1ae-685e5eb7301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.148205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b7c8cab1-f0c9-4bb5-b1ae-685e5eb7301b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:44.149458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b7c8cab1-f0c9-4bb5-b1ae-685e5eb7301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:44.157407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1214/2414] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:44.161802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5989afe-fe24-42e4-9e98-495eba672974 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.171847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5989afe-fe24-42e4-9e98-495eba672974 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.176579 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.177229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.177560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.177834 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.178565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:44.178864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.180433 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.192379 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1201/2415] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:52:44.196674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8cab1-f0c9-4bb5-b1ae-685e5eb7301b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.206338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8cab1-f0c9-4bb5-b1ae-685e5eb7301b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.211234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.211914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.212202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.212486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.213213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.215253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.239337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1215/2416] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:44.243417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.253768 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e79bfc-d4ce-4b1b-8c1a-cee70f63567c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.305985 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.306687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.306917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.307191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.307893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.310222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.333113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1202/2417] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:52:44.334266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.344593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a76ed-3c5b-43ac-800d-c7d19f0f1f22 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.349286 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.349967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.350253 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.350534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.351268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.352837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.363111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1216/2418] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:44.367028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.377022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1fcec-3b13-4122-9517-1f1c3ba676ca admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.381763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3fbdb-318c-4b76-8980-b12c57fdef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.382411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3fbdb-318c-4b76-8980-b12c57fdef5d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.382692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3fbdb-318c-4b76-8980-b12c57fdef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.382963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3fbdb-318c-4b76-8980-b12c57fdef5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.383682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3fbdb-318c-4b76-8980-b12c57fdef5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.385254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3fbdb-318c-4b76-8980-b12c57fdef5d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.395647 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1203/2419] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:44.399860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.410623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2cd9-ab75-431c-8dd2-453ad681234f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.415342 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.416289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.416648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.416992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] PATH_INFO: `/v3/projects/186ef60b4a794fed9ddc07d566bc1a51/users/1787fe82cd5840d599c2f69a1e00bfb0/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.431975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=186ef60b4a794fed9ddc07d566bc1a51, user_id=1787fe82cd5840d599c2f69a1e00bfb0, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.434674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.450204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1217/2420] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:44 2021] PUT /identity/v3/projects/186ef60b4a794fed9ddc07d566bc1a51/users/1787fe82cd5840d599c2f69a1e00bfb0/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:44.461779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ea15-23de-43e4-82b1-866d68027e7f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.462153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ea15-23de-43e4-82b1-866d68027e7f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.462505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9ea15-23de-43e4-82b1-866d68027e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.489227 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d2e9ea15-23de-43e4-82b1-866d68027e7f None None] MFA Rules not processed for user `1787fe82cd5840d599c2f69a1e00bfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:44.490492 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d2e9ea15-23de-43e4-82b1-866d68027e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:44.555173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1204/2421] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:44.559779 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.632721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f86e6-478c-46c3-b780-533f41de5d44 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.638033 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.638710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.639000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.639322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.640187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.641942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.674452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1218/2422] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:44.675837 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ea15-23de-43e4-82b1-866d68027e7f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.687374 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9ea15-23de-43e4-82b1-866d68027e7f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.746348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.746348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.746547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.746841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.747581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.750161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.770123 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1205/2423] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:44.773922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.783920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207ff42-8542-4e0f-bf3d-55b5532f7ab3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.788453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.789097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.789397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.789703 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.790429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.791992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.810958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1219/2424] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:44 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:44.815621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.826165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03c47a-3533-48d5-879a-b0088b50a3e1 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.831221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a5a8a-0ec3-462f-880f-e2ced7dc3832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.831944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5a8a-0ec3-462f-880f-e2ced7dc3832 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.832303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5a8a-0ec3-462f-880f-e2ced7dc3832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.832582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a5a8a-0ec3-462f-880f-e2ced7dc3832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.833316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a5a8a-0ec3-462f-880f-e2ced7dc3832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.834915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a5a8a-0ec3-462f-880f-e2ced7dc3832 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.845073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1206/2425] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:44.849046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:44.859281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec0869-b85f-43a8-b515-3eb01e28cf8b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:44.865934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:44.866850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.867138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.867447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] PATH_INFO: `/v3/projects/43fd41cf25754cc3ba43d81ee351c100/users/a309d6f9a47b416ebd0c615f14f9ebc9/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.883027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fd41cf25754cc3ba43d81ee351c100, user_id=a309d6f9a47b416ebd0c615f14f9ebc9, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:44.885686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:44.898448 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1220/2426] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:44 2021] PUT /identity/v3/projects/43fd41cf25754cc3ba43d81ee351c100/users/a309d6f9a47b416ebd0c615f14f9ebc9/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:44.909901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a958d-65a8-4e23-a47b-6a42f6e13e8a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:44.910192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a958d-65a8-4e23-a47b-6a42f6e13e8a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:44.910469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a958d-65a8-4e23-a47b-6a42f6e13e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:44.936478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-050a958d-65a8-4e23-a47b-6a42f6e13e8a None None] MFA Rules not processed for user `a309d6f9a47b416ebd0c615f14f9ebc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:44.937709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-050a958d-65a8-4e23-a47b-6a42f6e13e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:44.998484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1207/2427] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:44 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:45.003115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:45.067619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233e591-0b3b-4745-a46c-052b3a69dc37 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:45.072196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:45.072850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.073138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.073451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.074169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:45.076056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:45.103611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1221/2428] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:45 2021] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:45.107455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a958d-65a8-4e23-a47b-6a42f6e13e8a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:45.119159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a958d-65a8-4e23-a47b-6a42f6e13e8a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:45.173717 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:45.174385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.174670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.174948 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.175653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:45.177575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:45.196589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1208/2429] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:45 2021] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:45.200475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:45.210490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9391b81-91b9-47b3-9346-589afdb03a50 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:45.215196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:45.215854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.216148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.216445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.217165 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:45.219537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:45.230130 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1222/2430] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:45.234838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:45.244710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb7b3e-dc5e-4271-87b5-8a46ba34f6cd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:45.249338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:45.250294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.250601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.250883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] PATH_INFO: `/v3/projects/01625129648146b48e2f209734809f16/users/2bf6103be42848d2af4f59495fefb5b9/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.265821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01625129648146b48e2f209734809f16, user_id=2bf6103be42848d2af4f59495fefb5b9, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:45.268470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:45.282333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1209/2431] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:45 2021] PUT /identity/v3/projects/01625129648146b48e2f209734809f16/users/2bf6103be42848d2af4f59495fefb5b9/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:45.286362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:45.296351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd22b51-6773-4cbf-aabb-26686de50b1c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:45.351644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89831901-9504-4d6b-86a7-ab53b30abc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:45.352316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89831901-9504-4d6b-86a7-ab53b30abc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.352607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89831901-9504-4d6b-86a7-ab53b30abc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.352893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89831901-9504-4d6b-86a7-ab53b30abc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.353804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89831901-9504-4d6b-86a7-ab53b30abc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:45.355389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89831901-9504-4d6b-86a7-ab53b30abc56 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:45.365297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1223/2432] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:45 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:45.369246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:45.379603 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f58c21-82d6-4c06-b0cf-145ba8693293 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:45.384230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:45.385101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.385407 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.385691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] PATH_INFO: `/v3/projects/01625129648146b48e2f209734809f16/users/2bf6103be42848d2af4f59495fefb5b9/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.387646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=01625129648146b48e2f209734809f16, user_id=2bf6103be42848d2af4f59495fefb5b9, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:45.390806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:45.400679 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1210/2433] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:45 2021] PUT /identity/v3/projects/01625129648146b48e2f209734809f16/users/2bf6103be42848d2af4f59495fefb5b9/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:45.411491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.411786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.412071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.438922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] MFA Rules not processed for user `2bf6103be42848d2af4f59495fefb5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:45.440133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:45.509144 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1224/2434] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:45 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:45.520131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:45.521871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:45.575951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859985a5-16a7-462e-8936-6db4485cd3cd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:45.580153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:45.580790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:45.581081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:45.581362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:45.634742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:45.636100 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:45.645477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1211/2435] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:45 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:47.111423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:47.112878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:47.124473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7e4a0-4c8a-4e90-b1d7-b42594bb673c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:47.128051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:47.128675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:47.128965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:47.129245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:47.182887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:47.184313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:47.193007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1225/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:47 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:47.684623 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:47.692885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beebca-010b-4c17-aecc-3e2c612fe7ea service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:47.696477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09edf3-33d7-4359-b1b2-2853ed8cfc0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:47.697097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09edf3-33d7-4359-b1b2-2853ed8cfc0b service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:47.697402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09edf3-33d7-4359-b1b2-2853ed8cfc0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:47.697705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09edf3-33d7-4359-b1b2-2853ed8cfc0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:47.706830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09edf3-33d7-4359-b1b2-2853ed8cfc0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:47.708231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09edf3-33d7-4359-b1b2-2853ed8cfc0b service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:47.717186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1212/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:47 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:51.512944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:51.572766 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763495af-b09a-4b58-ac66-7b90d42a0595 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:51.577282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:51.578181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:51.578467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:51.578748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] PATH_INFO: `/v3/users/1787fe82cd5840d599c2f69a1e00bfb0` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:51.579945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1787fe82cd5840d599c2f69a1e00bfb0)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:51.581911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:51.627382 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1787fe82cd5840d599c2f69a1e00bfb0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:51.633704 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1787fe82cd5840d599c2f69a1e00bfb0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:51.640383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1787fe82cd5840d599c2f69a1e00bfb0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:51.641070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1787fe82cd5840d599c2f69a1e00bfb0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:51.652473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1787fe82cd5840d599c2f69a1e00bfb0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:51.658868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1226/2438] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:51 2021] DELETE /identity/v3/users/1787fe82cd5840d599c2f69a1e00bfb0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:51.663354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:51.663808 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:51.663923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:51.680789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:51.682020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:51.738585 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1213/2439] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:51.748235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:51.749646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:51.806350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405616b-0bcf-41b8-b129-bf28c811a85c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:51.809920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:51.810558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:51.810844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:51.811178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:51.820020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:51.821457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:51.830656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1227/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:52.082522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:52.083958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:52.096450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1609e-7b2a-4cb4-8c2e-7ca23385b47a None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:52.101108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:52.102011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:52.102297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:52.102573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] PATH_INFO: `/v3/projects/186ef60b4a794fed9ddc07d566bc1a51` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:52.104175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=186ef60b4a794fed9ddc07d566bc1a51)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:52.106431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:52.151708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186ef60b4a794fed9ddc07d566bc1a51', 'request_id': 'req-f17e769a-68a5-4931-ae7e-9e8bed803d9c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.157971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186ef60b4a794fed9ddc07d566bc1a51', 'request_id': 'req-f17e769a-68a5-4931-ae7e-9e8bed803d9c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.164088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186ef60b4a794fed9ddc07d566bc1a51', 'request_id': 'req-f17e769a-68a5-4931-ae7e-9e8bed803d9c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.174425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] The token cache is being invalidate because project 186ef60b4a794fed9ddc07d566bc1a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:52.174698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.175314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.176799 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1214/2441] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:52 2021] DELETE /identity/v3/projects/186ef60b4a794fed9ddc07d566bc1a51 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:52.180768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:52.190632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833e49-142e-4e12-a4df-d1e7a904ec0b service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:52.243691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:52.244538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:52.244820 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:52.245097 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] PATH_INFO: `/v3/users/a309d6f9a47b416ebd0c615f14f9ebc9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:52.246327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a309d6f9a47b416ebd0c615f14f9ebc9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:52.248217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:52.290564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a309d6f9a47b416ebd0c615f14f9ebc9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.298313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a309d6f9a47b416ebd0c615f14f9ebc9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.305241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a309d6f9a47b416ebd0c615f14f9ebc9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.305903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a309d6f9a47b416ebd0c615f14f9ebc9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.317619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a309d6f9a47b416ebd0c615f14f9ebc9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.323207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1228/2442] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:52 2021] DELETE /identity/v3/users/a309d6f9a47b416ebd0c615f14f9ebc9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:52.580849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:52.582279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:52.596187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e769a-68a5-4931-ae7e-9e8bed803d9c admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:52.649282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:52.650161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:52.650449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:52.650728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] PATH_INFO: `/v3/projects/43fd41cf25754cc3ba43d81ee351c100` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:52.651919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fd41cf25754cc3ba43d81ee351c100)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:52.653842 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:52.699846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fd41cf25754cc3ba43d81ee351c100', 'request_id': 'req-d633419b-5d19-4aa9-be55-4747648bff42'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.706900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fd41cf25754cc3ba43d81ee351c100', 'request_id': 'req-d633419b-5d19-4aa9-be55-4747648bff42'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.713103 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fd41cf25754cc3ba43d81ee351c100', 'request_id': 'req-d633419b-5d19-4aa9-be55-4747648bff42'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.723713 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] The token cache is being invalidate because project 43fd41cf25754cc3ba43d81ee351c100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:52.723995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.724606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.726145 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1215/2443] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:52 2021] DELETE /identity/v3/projects/43fd41cf25754cc3ba43d81ee351c100 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:52.730227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:52.731602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:52.745101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb319b-ba94-4448-a9cd-b0e9e7d8f5cd admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:52.799276 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:52.800132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:52.800423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:52.800708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] PATH_INFO: `/v3/users/2bf6103be42848d2af4f59495fefb5b9` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:52.801934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf6103be42848d2af4f59495fefb5b9)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:52.803856 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:52.849775 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf6103be42848d2af4f59495fefb5b9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.857063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf6103be42848d2af4f59495fefb5b9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.864108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf6103be42848d2af4f59495fefb5b9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.864864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf6103be42848d2af4f59495fefb5b9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.876522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-209eff30-b78a-45df-b425-1186be74cf49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf6103be42848d2af4f59495fefb5b9'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:52.882423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1229/2444] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:52:52 2021] DELETE /identity/v3/users/2bf6103be42848d2af4f59495fefb5b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:53.142858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.144448 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:53.156915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633419b-5d19-4aa9-be55-4747648bff42 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.211485 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.212341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.212621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.212892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] PATH_INFO: `/v3/projects/01625129648146b48e2f209734809f16` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.214104 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01625129648146b48e2f209734809f16)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.215986 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.259194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01625129648146b48e2f209734809f16', 'request_id': 'req-cc205452-e76d-42ee-8ccd-2110b5f07d80'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:53.266586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01625129648146b48e2f209734809f16', 'request_id': 'req-cc205452-e76d-42ee-8ccd-2110b5f07d80'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:53.272599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01625129648146b48e2f209734809f16', 'request_id': 'req-cc205452-e76d-42ee-8ccd-2110b5f07d80'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:53.282366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] The token cache is being invalidate because project 01625129648146b48e2f209734809f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:52:53.282655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:53.283273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cc205452-e76d-42ee-8ccd-2110b5f07d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:52:53.284771 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1216/2445] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:52:53 2021] DELETE /identity/v3/projects/01625129648146b48e2f209734809f16 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:53.290555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eae74-477a-4815-821c-b0c5a42e31ad None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.290853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eae74-477a-4815-821c-b0c5a42e31ad None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.291123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5eae74-477a-4815-821c-b0c5a42e31ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.309044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6a5eae74-477a-4815-821c-b0c5a42e31ad None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:53.310303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6a5eae74-477a-4815-821c-b0c5a42e31ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:53.366384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1230/2446] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:53.375567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551ef0-4a64-43ee-bbfc-3dc448e25496 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.375857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551ef0-4a64-43ee-bbfc-3dc448e25496 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.376162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551ef0-4a64-43ee-bbfc-3dc448e25496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.394482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-97551ef0-4a64-43ee-bbfc-3dc448e25496 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:53.395659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-97551ef0-4a64-43ee-bbfc-3dc448e25496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:53.403330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1217/2447] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:53.407332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eae74-477a-4815-821c-b0c5a42e31ad None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.416693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5eae74-477a-4815-821c-b0c5a42e31ad None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.421791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.422441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.422729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.423007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.423728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:52:53.424036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.425635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.437054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1231/2448] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:52:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:52:53.441004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97551ef0-4a64-43ee-bbfc-3dc448e25496 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.449800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97551ef0-4a64-43ee-bbfc-3dc448e25496 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.454908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.455536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.455817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.456089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.456780 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.458682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.482505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1218/2449] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:53 2021] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:53.486997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.496628 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2aa82-c5a9-4190-8a68-af9794587352 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.552156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.552816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.553102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.553393 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.554127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.556016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.575087 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1232/2450] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:53 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:53.579328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.589457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b8e20-1718-4d48-bfed-add03821b3a6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.594484 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.595158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.595446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.595724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.596452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.598110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.608930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1219/2451] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:53 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:53.612771 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.622435 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b539a84-52e4-42fc-bdd1-8decaba190cf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.627715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095399e-7aa0-4b9e-9eb4-af86448014a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.628362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095399e-7aa0-4b9e-9eb4-af86448014a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.628678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095399e-7aa0-4b9e-9eb4-af86448014a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.628963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095399e-7aa0-4b9e-9eb4-af86448014a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.629761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095399e-7aa0-4b9e-9eb4-af86448014a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.631333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095399e-7aa0-4b9e-9eb4-af86448014a1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.640954 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1233/2452] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:53.644776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.654419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9b75-62bd-4230-a37f-5272f99cad4d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.659028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.659879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.660165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.660444 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] PATH_INFO: `/v3/projects/b73d362cc56e4184b1481cb51a6186e3/users/942a19220f2349388b9549bdbab6ff4b/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.674932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73d362cc56e4184b1481cb51a6186e3, user_id=942a19220f2349388b9549bdbab6ff4b, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.677583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.690586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1220/2453] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:53 2021] PUT /identity/v3/projects/b73d362cc56e4184b1481cb51a6186e3/users/942a19220f2349388b9549bdbab6ff4b/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:52:53.695507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f998-7189-4bbb-85d4-62b5ec26c0b9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.695807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f998-7189-4bbb-85d4-62b5ec26c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.696119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632f998-7189-4bbb-85d4-62b5ec26c0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.713948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9632f998-7189-4bbb-85d4-62b5ec26c0b9 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:53.715135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9632f998-7189-4bbb-85d4-62b5ec26c0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:53.771359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1234/2454] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:53.781365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:53.783149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:53.837293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df0abc-3e08-4f8b-86c7-4d1eb62c58d8 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:53.841051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:53.841855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:53.842143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:53.843196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:53.851915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:53.853358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:53.863300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1221/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:52:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:52:57.725501 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531eb5-5d30-46af-9d4a-a01f6979e790 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:57.726632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531eb5-5d30-46af-9d4a-a01f6979e790 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:57.726942 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531eb5-5d30-46af-9d4a-a01f6979e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:57.760698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-55531eb5-5d30-46af-9d4a-a01f6979e790 None None] MFA Rules not processed for user `942a19220f2349388b9549bdbab6ff4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:52:57.761908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-55531eb5-5d30-46af-9d4a-a01f6979e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:52:57.829941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1235/2456] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:52:57 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:52:57.834522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:57.844732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317cf5b-aa9e-4ab8-a920-57c26031671e service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:57.849464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:57.850117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:57.850408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:57.850686 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:57.851418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:57.853323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:57.880341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1222/2457] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:52:57 2021] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:57.884418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55531eb5-5d30-46af-9d4a-a01f6979e790 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:57.895445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55531eb5-5d30-46af-9d4a-a01f6979e790 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:57.963950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:57.964647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:57.964936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:57.965219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:57.965992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:57.968928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:57.993450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1236/2458] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:52:57 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:52:57.994777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:58.005667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da61ba3-3d10-4504-bb99-7a13f729c61f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:58.010540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:58.011329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:58.011675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:58.011973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:58.012861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:58.015051 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:58.026473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1223/2459] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:57 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:58.032091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:58.042357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ddeae-77d7-467b-beae-24777806c3d4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:58.048000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:58.048791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:58.050186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:58.050493 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] PATH_INFO: `/v3/projects/1e4d368849104fd1a63230e27fb3bcfd/users/9ccd4aaa2f794e318997751296d697f5/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:58.065335 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4d368849104fd1a63230e27fb3bcfd, user_id=9ccd4aaa2f794e318997751296d697f5, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:58.067991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:58.086812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1237/2460] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:58 2021] PUT /identity/v3/projects/1e4d368849104fd1a63230e27fb3bcfd/users/9ccd4aaa2f794e318997751296d697f5/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:52:58.091376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:58.103242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de29e-cbde-4132-bb2a-daff17d5ff88 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:58.159960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bb9bf-248d-4a27-ad51-dfd2fa1b2b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:58.160741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bb9bf-248d-4a27-ad51-dfd2fa1b2b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:58.161098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bb9bf-248d-4a27-ad51-dfd2fa1b2b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:58.161482 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bb9bf-248d-4a27-ad51-dfd2fa1b2b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:58.162294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bb9bf-248d-4a27-ad51-dfd2fa1b2b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:58.163923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bb9bf-248d-4a27-ad51-dfd2fa1b2b2b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:58.174969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1224/2461] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:52:58 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:52:58.179036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:52:58.193345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffc966-84f0-4146-b4ad-3ed03468f270 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:52:58.198396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:52:58.199289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:52:58.199580 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:52:58.199867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] PATH_INFO: `/v3/projects/1e4d368849104fd1a63230e27fb3bcfd/users/9ccd4aaa2f794e318997751296d697f5/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:52:58.202555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4d368849104fd1a63230e27fb3bcfd, user_id=9ccd4aaa2f794e318997751296d697f5, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:52:58.205230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:52:58.216343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1238/2462] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:52:58 2021] PUT /identity/v3/projects/1e4d368849104fd1a63230e27fb3bcfd/users/9ccd4aaa2f794e318997751296d697f5/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:53:02.743081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:02.743604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:02.744329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:02.776295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] MFA Rules not processed for user `9ccd4aaa2f794e318997751296d697f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:02.777547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:02.876045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1225/2463] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:53:02 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:53:02.908959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:02.911533 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:03.008198 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814122c9-1b48-4736-aecf-fdd25dd28817 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:03.014393 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e4817-3e87-4724-8280-bd3e1fdedbf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:03.015318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4817-3e87-4724-8280-bd3e1fdedbf4 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:03.015609 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4817-3e87-4724-8280-bd3e1fdedbf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:03.015892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e4817-3e87-4724-8280-bd3e1fdedbf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:03.075401 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e4817-3e87-4724-8280-bd3e1fdedbf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:03.077242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e4817-3e87-4724-8280-bd3e1fdedbf4 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:03.086787 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1239/2464] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:02 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:04.011996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:04.013630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.071861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaab338-ad1b-411f-aaaf-195752e0431e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:04.075566 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:04.076225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.076537 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.076815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.078631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.095630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:04.098028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:04.110512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1226/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:04.875056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5cf3d-bbfe-44c3-9ff9-4cefe9454cd9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:04.875568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5cf3d-bbfe-44c3-9ff9-4cefe9454cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:04.875842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5cf3d-bbfe-44c3-9ff9-4cefe9454cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:04.898348 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a3b5cf3d-bbfe-44c3-9ff9-4cefe9454cd9 None None] MFA Rules not processed for user `942a19220f2349388b9549bdbab6ff4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:04.899568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a3b5cf3d-bbfe-44c3-9ff9-4cefe9454cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:04.906836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1240/2466] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:53:04 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:12.279508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:12.288324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0833fc-4e44-49ba-a3f4-8d8837593548 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:12.292039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:12.292675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:12.292963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:12.293244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:12.295171 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:12.354105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:12.357733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:12.368564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1227/2467] 10.222.0.48 () {60 vars in 1396 bytes} [Tue Oct 12 16:53:12 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3407 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:15.664029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.664534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.664641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.712427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:15.713583 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.777984 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1241/2468] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:53:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:15.822139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:15.824279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:15.917272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9446b2-00de-4020-97e1-f8492087fdb4 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:15.923471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:15.924151 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:15.924439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:15.924980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:15.936265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:15.937896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:15.946052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1228/2469] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:53:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:53:16.314475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:16.315976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:16.361555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12ac2e-54f7-4345-8a22-081270215b86 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:16.367811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:16.368728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:16.369025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:16.369303 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:16.371470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:16.445734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:16.447329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:16.460681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1242/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:16 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:17.040223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:17.050740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584b7e6-95f3-48cb-bfc6-43819acd1830 service swift] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:17.054605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a74999-581b-4e8c-b6a6-07432828718e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:17.055324 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a74999-581b-4e8c-b6a6-07432828718e service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:17.055670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a74999-581b-4e8c-b6a6-07432828718e service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:17.056038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a74999-581b-4e8c-b6a6-07432828718e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:17.058020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-72a74999-581b-4e8c-b6a6-07432828718e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:17.072884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a74999-581b-4e8c-b6a6-07432828718e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:17.074425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a74999-581b-4e8c-b6a6-07432828718e service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:17.091304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1229/2471] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:22.478836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:22.490956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6204db1-9f30-4b6f-b750-e45a93961346 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:22.495153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef69c4-9e5b-41ef-bbe8-bf4431386d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:22.495923 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef69c4-9e5b-41ef-bbe8-bf4431386d69 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:22.496311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef69c4-9e5b-41ef-bbe8-bf4431386d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:22.496708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef69c4-9e5b-41ef-bbe8-bf4431386d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:22.498650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-efef69c4-9e5b-41ef-bbe8-bf4431386d69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:22.509347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef69c4-9e5b-41ef-bbe8-bf4431386d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:22.510964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef69c4-9e5b-41ef-bbe8-bf4431386d69 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:22.519896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1243/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:22 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:23.053439 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a76dc0-6b7e-47fd-8871-aaffb3c61d81 None None] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.054395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a76dc0-6b7e-47fd-8871-aaffb3c61d81 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.054890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a76dc0-6b7e-47fd-8871-aaffb3c61d81 None None] PATH_INFO: `/` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.057596 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1230/2473] 10.222.0.48 () {54 vars in 960 bytes} [Tue Oct 12 16:53:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:53:23.063562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7034a-7f18-4827-8078-130598269df2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.063863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7034a-7f18-4827-8078-130598269df2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.064150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7034a-7f18-4827-8078-130598269df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.134155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-43a7034a-7f18-4827-8078-130598269df2 None None] MFA Rules not processed for user `32dbbc4af72f4d11a9b1876dba8e886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:23.135899 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-43a7034a-7f18-4827-8078-130598269df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:23.220680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1244/2474] 10.222.0.48 () {58 vars in 1057 bytes} [Tue Oct 12 16:53:23 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:23.229184 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a76dc0-6b7e-47fd-8871-aaffb3c61d81 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:23.246762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a76dc0-6b7e-47fd-8871-aaffb3c61d81 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:23.252580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:23.253562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:23.254007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:23.254476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:23.256326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:23.268633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:23.270494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:23.282069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1231/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:23 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:25.428809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7034a-7f18-4827-8078-130598269df2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:25.440637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7034a-7f18-4827-8078-130598269df2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:25.479914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2367ede-4daa-4ae9-9a6e-9f6602a68378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:25.493311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367ede-4daa-4ae9-9a6e-9f6602a68378 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:25.494800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367ede-4daa-4ae9-9a6e-9f6602a68378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:25.495098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2367ede-4daa-4ae9-9a6e-9f6602a68378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:25.502477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c2367ede-4daa-4ae9-9a6e-9f6602a68378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:25.535206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2367ede-4daa-4ae9-9a6e-9f6602a68378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:25.536658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2367ede-4daa-4ae9-9a6e-9f6602a68378 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:25.564993 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1245/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:25 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:26.561452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:26.584471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77245936-a5e3-46e0-87c9-98154881cde3 service placement] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:26.600295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:26.605611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:26.606112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:26.606556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:26.608897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:26.625192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:26.628225 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:26.646468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1232/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:34.009635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240bebe-f2de-4be2-a025-a8a66867b065 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.010098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240bebe-f2de-4be2-a025-a8a66867b065 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.010207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240bebe-f2de-4be2-a025-a8a66867b065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.027554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b240bebe-f2de-4be2-a025-a8a66867b065 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:34.028741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b240bebe-f2de-4be2-a025-a8a66867b065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.035900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1246/2478] 10.222.0.48 () {58 vars in 1009 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:34.048918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.059788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553f9ac-b0dc-4a06-bbc0-843fcc9f5160 service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.065517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.066095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.066382 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.066662 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.074812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.076377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.084303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1233/2479] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:53:34.152456 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.152801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.153085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.182598 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:34.188002 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:34.207884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1247/2480] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 12 16:53:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:34.240447 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:34.262981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0468-dbb0-4858-a072-38104e1993f5 service swift] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:34.275003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:34.276595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:34.277275 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:34.277923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:34.292251 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:34.294744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:34.305124 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1234/2481] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:53:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:53:43.031349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:43.034025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:43.142755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce5db6-cf95-4ed5-aba9-c08d54a0abb8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:43.147458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:43.148353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:43.148636 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:43.148911 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] PATH_INFO: `/v3/users/b1a7fa4717c9404c9c5933e4f025ee2e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:43.150230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a7fa4717c9404c9c5933e4f025ee2e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:43.152168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:43.208964 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a7fa4717c9404c9c5933e4f025ee2e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.219098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a7fa4717c9404c9c5933e4f025ee2e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.227957 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a7fa4717c9404c9c5933e4f025ee2e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.228812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a7fa4717c9404c9c5933e4f025ee2e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.242341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a7fa4717c9404c9c5933e4f025ee2e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.249066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1248/2482] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:43 2021] DELETE /identity/v3/users/b1a7fa4717c9404c9c5933e4f025ee2e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:43.469942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:43.487556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21df5c-7aa9-4d29-abf3-16d68f2f4a02 service swift] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:43.548653 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:43.549443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:43.549731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:43.550067 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] PATH_INFO: `/v3/projects/6b276008196643ce9a2938b78207fc0c` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:43.551202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b276008196643ce9a2938b78207fc0c)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:43.553110 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:43.611108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b276008196643ce9a2938b78207fc0c', 'request_id': 'req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.619009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b276008196643ce9a2938b78207fc0c', 'request_id': 'req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.626940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b276008196643ce9a2938b78207fc0c', 'request_id': 'req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.645661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] The token cache is being invalidate because project 6b276008196643ce9a2938b78207fc0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:43.646056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.646877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.648512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1235/2483] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:43 2021] DELETE /identity/v3/projects/6b276008196643ce9a2938b78207fc0c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:43.654285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:43.655895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:43.669242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fe277-fa21-4ea1-8a47-fe34b8ada018 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:43.732133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:43.733641 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:43.734000 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:43.734350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] PATH_INFO: `/v3/users/14007fa59e434d4d886486eae323e900` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:43.735633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14007fa59e434d4d886486eae323e900)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:43.737670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:43.786705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14007fa59e434d4d886486eae323e900'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.794290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14007fa59e434d4d886486eae323e900'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.801707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14007fa59e434d4d886486eae323e900'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.802296 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14007fa59e434d4d886486eae323e900'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.814309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14007fa59e434d4d886486eae323e900'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:43.820070 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1249/2484] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:53:43 2021] DELETE /identity/v3/users/14007fa59e434d4d886486eae323e900 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:43.994437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:43.995996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:44.012394 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4366-17c5-4fe6-b4bf-95fa40dbce42 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:44.068370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:44.069156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:44.069480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:44.069760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] PATH_INFO: `/v3/projects/684877887e9549cda1aae83d0cd767c3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:44.070975 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684877887e9549cda1aae83d0cd767c3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:44.072877 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:44.117883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684877887e9549cda1aae83d0cd767c3', 'request_id': 'req-a28e708a-58d5-400d-8c73-521781096398'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:44.124668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684877887e9549cda1aae83d0cd767c3', 'request_id': 'req-a28e708a-58d5-400d-8c73-521781096398'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:44.130688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684877887e9549cda1aae83d0cd767c3', 'request_id': 'req-a28e708a-58d5-400d-8c73-521781096398'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:44.140421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] The token cache is being invalidate because project 684877887e9549cda1aae83d0cd767c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:53:44.140714 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:44.141337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:53:44.142871 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1236/2485] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:53:43 2021] DELETE /identity/v3/projects/684877887e9549cda1aae83d0cd767c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:53:46.270777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:46.272209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:46.327149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131c5bc-a366-412e-8d90-e6b169adc6b8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:46.373851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214267e-97d9-4729-a0e3-3a0687f2be30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:46.374498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214267e-97d9-4729-a0e3-3a0687f2be30 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:46.374786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214267e-97d9-4729-a0e3-3a0687f2be30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:46.375066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214267e-97d9-4729-a0e3-3a0687f2be30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:46.376831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5214267e-97d9-4729-a0e3-3a0687f2be30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:46.436029 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214267e-97d9-4729-a0e3-3a0687f2be30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:46.437426 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214267e-97d9-4729-a0e3-3a0687f2be30 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:46.446726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1250/2486] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:46 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:53:49.037770 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:49.039353 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:49.129015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e708a-58d5-400d-8c73-521781096398 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:49.134951 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:49.135631 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:49.135917 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:49.136196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:49.138108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:49.151238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:49.158962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:49.171449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1237/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:53:49 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:53:50.687781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.688284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.688386 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.705322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] MFA Rules not processed for user `de964adbd34c4ad482354893e9256490`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:53:50.706554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:50.760027 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1251/2488] 10.222.0.48 () {58 vars in 967 bytes} [Tue Oct 12 16:53:50 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:53:50.772682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:53:50.774064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:53:50.838395 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9057b-f81c-40ca-afcd-ae0efad991c1 service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:53:50.844121 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c6cef3217904adcadea1a58a7b146e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:53:50.844754 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:53:50.845039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:53:50.845318 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:53:50.853199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:53:50.854800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:53:50.863270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1238/2489] 10.222.0.48 () {60 vars in 1384 bytes} [Tue Oct 12 16:53:50 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 16:54:09.834158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:09.835481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:09.851882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc33dd4-fe59-4060-a8a1-e5f57164cfbd None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:09.858524 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:09.859196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:09.859510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:09.859763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:09.861832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:09.875013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:09.876572 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:09.887542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1252/2490] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:15.886301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:15.887841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:15.900520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6316e-11f4-4acf-9dc6-4d91921d1dd1 service swift] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:15.904775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:15.905442 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:15.905735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:15.906013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:15.907826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:15.969841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:15.971272 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:15.980802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1239/2491] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:19.362294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:19.363741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:19.377893 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87366ef-92f3-4b4f-bd48-08fa62b257e8 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:19.382656 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:19.383516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.383808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.384093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] PATH_INFO: `/v3/users/6363ee6ea7c441ccbd9d8dc5ab30cebe` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.385281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6363ee6ea7c441ccbd9d8dc5ab30cebe)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:19.387249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:19.431119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6363ee6ea7c441ccbd9d8dc5ab30cebe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.438390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6363ee6ea7c441ccbd9d8dc5ab30cebe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.445410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6363ee6ea7c441ccbd9d8dc5ab30cebe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.446047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6363ee6ea7c441ccbd9d8dc5ab30cebe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.457199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-eeb44014-a8fa-4f1e-b07f-efdcdea042cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6363ee6ea7c441ccbd9d8dc5ab30cebe'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.462982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1253/2492] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:19 2021] DELETE /identity/v3/users/6363ee6ea7c441ccbd9d8dc5ab30cebe => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:19.628055 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:19.638264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934061ff-54e7-4132-a8cd-58a95a6fc58a service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:19.693798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:19.694636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.694924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.695201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] PATH_INFO: `/v3/projects/bef38560185b407ea90862e9626f9afc` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.696385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef38560185b407ea90862e9626f9afc)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:19.698325 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:19.743646 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef38560185b407ea90862e9626f9afc', 'request_id': 'req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.750861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef38560185b407ea90862e9626f9afc', 'request_id': 'req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.756960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef38560185b407ea90862e9626f9afc', 'request_id': 'req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.766520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] The token cache is being invalidate because project bef38560185b407ea90862e9626f9afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:19.766802 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.767417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a4505a5f-1c4c-4b4c-ac72-a8e91f89669d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:19.768921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1240/2493] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:19 2021] DELETE /identity/v3/projects/bef38560185b407ea90862e9626f9afc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:19.775392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee604d7f-ef2b-4b1f-85e5-e5c234f932ad None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.775686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee604d7f-ef2b-4b1f-85e5-e5c234f932ad None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.775968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee604d7f-ef2b-4b1f-85e5-e5c234f932ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.793492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ee604d7f-ef2b-4b1f-85e5-e5c234f932ad None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:19.795367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ee604d7f-ef2b-4b1f-85e5-e5c234f932ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:19.850755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1254/2494] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:19.859303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34dd44-6909-497c-a3bf-d38dc7daf056 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.859593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34dd44-6909-497c-a3bf-d38dc7daf056 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.859903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34dd44-6909-497c-a3bf-d38dc7daf056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.877656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-8a34dd44-6909-497c-a3bf-d38dc7daf056 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:19.878858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8a34dd44-6909-497c-a3bf-d38dc7daf056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:19.886919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1241/2495] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:54:19.891035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee604d7f-ef2b-4b1f-85e5-e5c234f932ad None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:19.900361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee604d7f-ef2b-4b1f-85e5-e5c234f932ad None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:19.905560 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:19.906209 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.906496 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.906778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.907511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:19.907826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:19.909444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:19.921178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1255/2496] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:54:19.925254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34dd44-6909-497c-a3bf-d38dc7daf056 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:19.934190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34dd44-6909-497c-a3bf-d38dc7daf056 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:19.938860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:19.939498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:19.939785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:19.940065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:19.940790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:19.942701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:19.967425 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1242/2497] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:19 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:19.971765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:19.981717 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a13ab-4b68-4815-a163-bc0d0b9ce8d9 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:20.037638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:20.038341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:20.038632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:20.038917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:20.039637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:20.041597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:20.063258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1256/2498] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:19 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:20.064373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:20.074236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5241a-f882-4a52-94b9-577865321600 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:20.078882 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:20.079529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:20.079816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:20.080097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:20.080830 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:20.082510 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:20.093250 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1243/2499] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:54:20.097763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:20.108159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7eba5-f345-4ccd-969b-67c3a1fa1f48 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:20.112851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b08c-372a-4a2e-9581-74586229a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:20.113554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b08c-372a-4a2e-9581-74586229a2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:20.113847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b08c-372a-4a2e-9581-74586229a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:20.114134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b08c-372a-4a2e-9581-74586229a2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:20.114879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b08c-372a-4a2e-9581-74586229a2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:20.116462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b08c-372a-4a2e-9581-74586229a2b6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:20.126377 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1257/2500] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:20.130386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:20.140642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1c17b-919b-437d-b266-c0dc5c0aca13 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:20.145307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:20.146230 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:20.146515 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:20.146805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] PATH_INFO: `/v3/projects/f87a22f14eae4b98ad8daaa62eb5f82a/users/f23ed6c54b9f47ffb4a2cef5503d5396/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:20.161389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87a22f14eae4b98ad8daaa62eb5f82a, user_id=f23ed6c54b9f47ffb4a2cef5503d5396, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:20.164007 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:20.176419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1244/2501] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:20 2021] PUT /identity/v3/projects/f87a22f14eae4b98ad8daaa62eb5f82a/users/f23ed6c54b9f47ffb4a2cef5503d5396/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:20.181404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13585-8ed6-4114-8bd2-85171296d8e0 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:20.181722 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13585-8ed6-4114-8bd2-85171296d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:20.182005 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a13585-8ed6-4114-8bd2-85171296d8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:20.199283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c7a13585-8ed6-4114-8bd2-85171296d8e0 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:20.200476 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c7a13585-8ed6-4114-8bd2-85171296d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:20.257113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1258/2502] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:20.267263 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:20.268922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:20.322090 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9572a6-346d-4ddd-b551-2cc3a93eeda2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:20.325656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a969-d304-4b6b-b972-4c5107e4afbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:20.326826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a969-d304-4b6b-b972-4c5107e4afbb service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:20.327108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a969-d304-4b6b-b972-4c5107e4afbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:20.327384 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a969-d304-4b6b-b972-4c5107e4afbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:20.336074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a969-d304-4b6b-b972-4c5107e4afbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:20.337517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a969-d304-4b6b-b972-4c5107e4afbb service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:20.347512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1245/2503] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:20.933351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:20.933863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:20.933968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:20.962950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] MFA Rules not processed for user `f23ed6c54b9f47ffb4a2cef5503d5396`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:20.964250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:21.027546 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1259/2504] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:20 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:21.037978 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72021e-34d1-4d7b-83fe-a923ef9248ff None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:21.038530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72021e-34d1-4d7b-83fe-a923ef9248ff None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:21.038530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72021e-34d1-4d7b-83fe-a923ef9248ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:21.056280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-ac72021e-34d1-4d7b-83fe-a923ef9248ff None None] MFA Rules not processed for user `f23ed6c54b9f47ffb4a2cef5503d5396`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:21.057534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ac72021e-34d1-4d7b-83fe-a923ef9248ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:21.065818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1246/2505] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:21 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:21.077569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:21.078980 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:21.159098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62315cfc-b0ac-477d-b1fe-c287104c7daf None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:21.164586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:21.165225 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:21.165538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:21.165818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:21.174109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:21.175673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:21.184288 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1260/2506] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:21 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:36.795354 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72021e-34d1-4d7b-83fe-a923ef9248ff None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:36.805880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72021e-34d1-4d7b-83fe-a923ef9248ff None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:36.809629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652b537-3dd3-4198-ad06-cf4902cc7233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:36.810270 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b537-3dd3-4198-ad06-cf4902cc7233 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:36.810553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b537-3dd3-4198-ad06-cf4902cc7233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:36.810855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b537-3dd3-4198-ad06-cf4902cc7233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:36.812636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3652b537-3dd3-4198-ad06-cf4902cc7233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:36.824334 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652b537-3dd3-4198-ad06-cf4902cc7233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:36.825798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652b537-3dd3-4198-ad06-cf4902cc7233 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:36.835698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1247/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:39.957196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:39.959394 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:39.975059 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8bd99-3ea4-44e8-9909-7fb8e0df1578 service nova] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:39.979937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:39.981120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:39.988336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:39.988629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] PATH_INFO: `/v3/users/80558ff481cc4871b5f3f361c42edd17` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:39.990135 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80558ff481cc4871b5f3f361c42edd17)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:39.992362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.041534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80558ff481cc4871b5f3f361c42edd17'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.049504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80558ff481cc4871b5f3f361c42edd17'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.056285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80558ff481cc4871b5f3f361c42edd17'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.056922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80558ff481cc4871b5f3f361c42edd17'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.069832 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80558ff481cc4871b5f3f361c42edd17'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.076006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1261/2508] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:39 2021] DELETE /identity/v3/users/80558ff481cc4871b5f3f361c42edd17 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:40.095918 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6290-1aee-406b-a2a6-19977d3c9440 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.096496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6290-1aee-406b-a2a6-19977d3c9440 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.096687 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6290-1aee-406b-a2a6-19977d3c9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.115216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-25ab6290-1aee-406b-a2a6-19977d3c9440 None None] MFA Rules not processed for user `f23ed6c54b9f47ffb4a2cef5503d5396`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:40.116434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-25ab6290-1aee-406b-a2a6-19977d3c9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:40.174335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1248/2509] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:40 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:40.263353 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.265801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:40.328367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc846e5b-5a47-4222-812d-9db1ea996940 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.333481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.334036 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.334326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.334603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] PATH_INFO: `/v3/projects/ea06ba2e773d42f1ab5ae2a60f8dd8d6` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.335816 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea06ba2e773d42f1ab5ae2a60f8dd8d6)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.338259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.391194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea06ba2e773d42f1ab5ae2a60f8dd8d6', 'request_id': 'req-07fc62fb-6b3d-4462-8255-6129fe35e55e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.398509 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea06ba2e773d42f1ab5ae2a60f8dd8d6', 'request_id': 'req-07fc62fb-6b3d-4462-8255-6129fe35e55e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.404825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea06ba2e773d42f1ab5ae2a60f8dd8d6', 'request_id': 'req-07fc62fb-6b3d-4462-8255-6129fe35e55e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.414990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] The token cache is being invalidate because project ea06ba2e773d42f1ab5ae2a60f8dd8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:40.415282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.415929 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-07fc62fb-6b3d-4462-8255-6129fe35e55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:40.417490 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1262/2510] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:40 2021] DELETE /identity/v3/projects/ea06ba2e773d42f1ab5ae2a60f8dd8d6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:40.423932 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be3e0-f5d9-4547-9187-ec512fd86d6f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.424291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be3e0-f5d9-4547-9187-ec512fd86d6f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.424688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be3e0-f5d9-4547-9187-ec512fd86d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.442865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-e98be3e0-f5d9-4547-9187-ec512fd86d6f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:40.444118 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e98be3e0-f5d9-4547-9187-ec512fd86d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:40.501586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1249/2511] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:40.509521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5447a4-d309-4610-b78b-0de44e85e3c8 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.509880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5447a4-d309-4610-b78b-0de44e85e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.510226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5447a4-d309-4610-b78b-0de44e85e3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.529738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-dd5447a4-d309-4610-b78b-0de44e85e3c8 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:40.530958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dd5447a4-d309-4610-b78b-0de44e85e3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:40.539549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1263/2512] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:40.543719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be3e0-f5d9-4547-9187-ec512fd86d6f None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.554755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be3e0-f5d9-4547-9187-ec512fd86d6f None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.559364 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.560042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.560323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.561165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.561934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:40.562240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.563817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.575001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1250/2513] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:40.579283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5447a4-d309-4610-b78b-0de44e85e3c8 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.588241 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5447a4-d309-4610-b78b-0de44e85e3c8 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.592828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.593508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.593793 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.594331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.595046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.596919 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.632309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1264/2514] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:40 2021] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:40.636481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.646562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76814d5e-0e3b-4e68-8887-22d5a5ee4fee admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.700898 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.702248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.702546 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.702832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.703556 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.705617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.728442 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1251/2515] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:40 2021] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:40.732040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.744646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e79022-5b69-4ff1-bcf8-0dd5bc9e127c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.749600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.750331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.751721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.752170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.753325 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.755822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.766991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1265/2516] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:40 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:40.771027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.783970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be13327-11ff-4508-bf10-e340ee02a7e0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.789582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103895-7787-4342-b0d9-0a1d11b1afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.790543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103895-7787-4342-b0d9-0a1d11b1afd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.791710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103895-7787-4342-b0d9-0a1d11b1afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.792072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103895-7787-4342-b0d9-0a1d11b1afd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.792746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103895-7787-4342-b0d9-0a1d11b1afd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.794358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103895-7787-4342-b0d9-0a1d11b1afd7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.808919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1252/2517] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:40 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:40.810001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:40.819905 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500164-58ee-4ba7-8443-3f7712d03bc1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:40.824946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:40.825853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.826143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.826477 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] PATH_INFO: `/v3/projects/7837fbca389f420b8b2aabe05f9ee2de/users/a3a0be81501144dcba099ec3d59162b8/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.840753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7837fbca389f420b8b2aabe05f9ee2de, user_id=a3a0be81501144dcba099ec3d59162b8, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:40.844419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:40.858640 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1266/2518] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:40 2021] PUT /identity/v3/projects/7837fbca389f420b8b2aabe05f9ee2de/users/a3a0be81501144dcba099ec3d59162b8/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:40.868571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8be6f-c63d-48f8-ae19-434922a38c42 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:40.868901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8be6f-c63d-48f8-ae19-434922a38c42 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:40.869188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8be6f-c63d-48f8-ae19-434922a38c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:40.895693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-77e8be6f-c63d-48f8-ae19-434922a38c42 None None] MFA Rules not processed for user `a3a0be81501144dcba099ec3d59162b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:40.896923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-77e8be6f-c63d-48f8-ae19-434922a38c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:40.973856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1253/2519] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:40 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:40.978279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.047369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d716e8-fcc6-4d24-b97b-ca7abcd1647f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.055040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.055770 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.056122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.057334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.057860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.059662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.085404 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1267/2520] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:40 2021] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:41.088377 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8be6f-c63d-48f8-ae19-434922a38c42 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.099974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8be6f-c63d-48f8-ae19-434922a38c42 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.155308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.156362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.156685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.156972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.157712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.159621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.178957 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1254/2521] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:41 2021] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:41.182763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.193202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad56f3-beba-4bc5-a024-65c8393d25ff admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.197844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.198561 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.198850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.199127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.200021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.202356 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.213098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1268/2522] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:41.217779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.227841 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cd906-67fc-415e-bf4f-dbc63711cf45 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.232434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.233329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.233638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.233914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] PATH_INFO: `/v3/projects/2a036b7192004680baafeda790c83f3e/users/ac4404734cff4e828b0fd3901cfde977/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.248409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a036b7192004680baafeda790c83f3e, user_id=ac4404734cff4e828b0fd3901cfde977, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.251307 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.264740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1255/2523] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:41 2021] PUT /identity/v3/projects/2a036b7192004680baafeda790c83f3e/users/ac4404734cff4e828b0fd3901cfde977/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:41.268686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.278695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccfb30-3586-4d33-9fe0-b7b71e8a4c50 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.334977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d2334-7576-4d03-a567-55fbe428a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.335647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d2334-7576-4d03-a567-55fbe428a1ee admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.335935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d2334-7576-4d03-a567-55fbe428a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.336216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d2334-7576-4d03-a567-55fbe428a1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.336950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d2334-7576-4d03-a567-55fbe428a1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.338569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d2334-7576-4d03-a567-55fbe428a1ee admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.349004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1269/2524] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:41 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:41.353549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.363665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7bc22-ef09-46f1-9cfd-14a0bb9437ba admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.368296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.369221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.369544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.369827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] PATH_INFO: `/v3/projects/2a036b7192004680baafeda790c83f3e/users/ac4404734cff4e828b0fd3901cfde977/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.371908 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a036b7192004680baafeda790c83f3e, user_id=ac4404734cff4e828b0fd3901cfde977, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.374572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.385593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1256/2525] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:41 2021] PUT /identity/v3/projects/2a036b7192004680baafeda790c83f3e/users/ac4404734cff4e828b0fd3901cfde977/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:41.397221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26bb7b-e323-49e2-b7c5-c3898cd15845 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.397549 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26bb7b-e323-49e2-b7c5-c3898cd15845 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.397852 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26bb7b-e323-49e2-b7c5-c3898cd15845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.423807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-3f26bb7b-e323-49e2-b7c5-c3898cd15845 None None] MFA Rules not processed for user `ac4404734cff4e828b0fd3901cfde977`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:41.425001 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3f26bb7b-e323-49e2-b7c5-c3898cd15845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:41.489539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1270/2526] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:41 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:41.500583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.502288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:41.555163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132c05b-1238-4649-be2e-a201b7ffc18a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.558973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.559620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.559907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.560186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.570135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.571553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.582752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1257/2527] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:41 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:41.653568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26bb7b-e323-49e2-b7c5-c3898cd15845 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:41.663863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26bb7b-e323-49e2-b7c5-c3898cd15845 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:41.667531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e2d65-b5ef-4ca1-8a18-e508229233b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:41.668169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e2d65-b5ef-4ca1-8a18-e508229233b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:41.668454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e2d65-b5ef-4ca1-8a18-e508229233b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:41.668731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e2d65-b5ef-4ca1-8a18-e508229233b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:41.726529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e2d65-b5ef-4ca1-8a18-e508229233b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:41.728629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e2d65-b5ef-4ca1-8a18-e508229233b0 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:41.738372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1271/2528] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:41 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:44.462526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.520887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fa4b2-ceff-48cb-922f-e00bfa95b732 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.525413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.526273 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.526553 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.526825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] PATH_INFO: `/v3/users/a3a0be81501144dcba099ec3d59162b8` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.527993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a0be81501144dcba099ec3d59162b8)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.530568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.573762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a0be81501144dcba099ec3d59162b8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.574411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a0be81501144dcba099ec3d59162b8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.581445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a0be81501144dcba099ec3d59162b8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.587923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a0be81501144dcba099ec3d59162b8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.588555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a0be81501144dcba099ec3d59162b8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:44.605549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1258/2529] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:44 2021] DELETE /identity/v3/users/a3a0be81501144dcba099ec3d59162b8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:44.610701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.611189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.611301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.628563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:44.629811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:44.689433 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1272/2530] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:44.699434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:44.700827 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:44.755426 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63067117-f085-4dcb-a9ff-084abdc63476 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:44.759088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:44.759720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:44.760003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:44.760280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:44.768977 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:44.770494 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:44.780139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1259/2531] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:45.038425 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.039990 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.052755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8612cb-82dc-401f-82a0-807a674a74de None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.057894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.058755 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.059041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.059317 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] PATH_INFO: `/v3/projects/7837fbca389f420b8b2aabe05f9ee2de` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.060557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7837fbca389f420b8b2aabe05f9ee2de)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.062508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.113044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7837fbca389f420b8b2aabe05f9ee2de', 'request_id': 'req-c5a349c4-2296-46af-856b-f1f23c39167d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.120430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7837fbca389f420b8b2aabe05f9ee2de', 'request_id': 'req-c5a349c4-2296-46af-856b-f1f23c39167d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.126881 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7837fbca389f420b8b2aabe05f9ee2de', 'request_id': 'req-c5a349c4-2296-46af-856b-f1f23c39167d'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.136958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] The token cache is being invalidate because project 7837fbca389f420b8b2aabe05f9ee2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:45.137252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.137940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.140406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1273/2532] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:45 2021] DELETE /identity/v3/projects/7837fbca389f420b8b2aabe05f9ee2de => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:45.144376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.154185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65860e6b-f030-4e07-becf-9d292ccd9663 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.211517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.212376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.212655 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.212927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] PATH_INFO: `/v3/users/ac4404734cff4e828b0fd3901cfde977` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.214252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4404734cff4e828b0fd3901cfde977)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.216155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.260711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4404734cff4e828b0fd3901cfde977'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.261402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4404734cff4e828b0fd3901cfde977'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.269183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4404734cff4e828b0fd3901cfde977'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.275788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4404734cff4e828b0fd3901cfde977'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.276406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-254f6487-864f-4c96-9efd-e54d5f0c1271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4404734cff4e828b0fd3901cfde977'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.292695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1260/2533] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:54:45 2021] DELETE /identity/v3/users/ac4404734cff4e828b0fd3901cfde977 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:45.562790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.564602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.578705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a349c4-2296-46af-856b-f1f23c39167d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.636418 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.637288 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.637711 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.638332 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] PATH_INFO: `/v3/projects/2a036b7192004680baafeda790c83f3e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.639757 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a036b7192004680baafeda790c83f3e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.641675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.686302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a036b7192004680baafeda790c83f3e', 'request_id': 'req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.693031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a036b7192004680baafeda790c83f3e', 'request_id': 'req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.699154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a036b7192004680baafeda790c83f3e', 'request_id': 'req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.708913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] The token cache is being invalidate because project 2a036b7192004680baafeda790c83f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:54:45.709199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.709859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d7f3f7c7-4fc3-4585-b783-53d7c695cab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:54:45.711349 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1274/2534] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:54:45 2021] DELETE /identity/v3/projects/2a036b7192004680baafeda790c83f3e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:45.717365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0d0a-f104-4424-b1a5-e12f7c9b9df6 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.717864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0d0a-f104-4424-b1a5-e12f7c9b9df6 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.717966 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b0d0a-f104-4424-b1a5-e12f7c9b9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.735639 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-307b0d0a-f104-4424-b1a5-e12f7c9b9df6 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:45.736820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-307b0d0a-f104-4424-b1a5-e12f7c9b9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.792177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1261/2535] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:45.800122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f3dc-fc08-4e31-a64c-39f054257d45 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.800412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f3dc-fc08-4e31-a64c-39f054257d45 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.800693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929f3dc-fc08-4e31-a64c-39f054257d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.818802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-2929f3dc-fc08-4e31-a64c-39f054257d45 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:45.819916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2929f3dc-fc08-4e31-a64c-39f054257d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:45.827615 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1275/2536] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:45.831690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0d0a-f104-4424-b1a5-e12f7c9b9df6 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.840982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b0d0a-f104-4424-b1a5-e12f7c9b9df6 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.846067 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.846701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.846984 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.847267 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.847988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:54:45.848298 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.849915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.861785 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1262/2537] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:54:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:54:45.865768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929f3dc-fc08-4e31-a64c-39f054257d45 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.875360 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929f3dc-fc08-4e31-a64c-39f054257d45 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.880294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.880933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.881220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.881537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.882237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.884120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.908309 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1276/2538] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:45 2021] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:45.912308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:45.922887 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed449c-c145-4b80-a323-7af84f8637be admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:45.976880 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:45.977571 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:45.977860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:45.978141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:45.978846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:45.980744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:45.999989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1263/2539] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:45 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:46.004190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.014315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc07f78-be81-46ae-8771-c27d2d75a4cb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.019024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.019673 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.019983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.020262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.020989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.022602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.033204 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1277/2540] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:46.036969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.047150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf254470-eb91-4705-9091-45213d3c62f9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.051726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c3c23-ae35-46d4-aa64-fe9d9fc834de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.052366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3c23-ae35-46d4-aa64-fe9d9fc834de admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.052650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3c23-ae35-46d4-aa64-fe9d9fc834de admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.052926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c3c23-ae35-46d4-aa64-fe9d9fc834de admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.053692 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c3c23-ae35-46d4-aa64-fe9d9fc834de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.055253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c3c23-ae35-46d4-aa64-fe9d9fc834de admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.064890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1264/2541] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:46.068938 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.078700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa5d47-c3d5-4fc0-9f5b-bc910f73d3d8 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.083275 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.084133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.084419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.084693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] PATH_INFO: `/v3/projects/5a24dd6aa4e846c5aff9114f2e41fed7/users/9871b0228162407da3d5ebcfff0fa7a1/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.099903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a24dd6aa4e846c5aff9114f2e41fed7, user_id=9871b0228162407da3d5ebcfff0fa7a1, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.102861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.115633 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1278/2542] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:46 2021] PUT /identity/v3/projects/5a24dd6aa4e846c5aff9114f2e41fed7/users/9871b0228162407da3d5ebcfff0fa7a1/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:46.125720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fd851-9744-4684-b699-8a949701a95e None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.126014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fd851-9744-4684-b699-8a949701a95e None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.126294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fd851-9744-4684-b699-8a949701a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.151226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1f0fd851-9744-4684-b699-8a949701a95e None None] MFA Rules not processed for user `9871b0228162407da3d5ebcfff0fa7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:46.152414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1f0fd851-9744-4684-b699-8a949701a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.214543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1265/2543] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:46.219670 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.277475 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05278072-1f31-4f02-a54b-ee7d5da4578d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.282684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.283331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.283619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.283897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.284618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.287843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.312371 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1279/2544] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:54:46.316551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fd851-9744-4684-b699-8a949701a95e None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.327670 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fd851-9744-4684-b699-8a949701a95e None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.380903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.381589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.381879 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.382157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.382847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.384735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.406094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1266/2545] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:54:46.408014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.418254 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd660e6-4786-4d9a-89ff-61cd59274098 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.422926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.423578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.423870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.424153 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.424894 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.426510 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.436985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1280/2546] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:46.440997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.451027 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea2a36-21a3-493c-a9a8-d06c75d94c9b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.456173 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.457070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.457406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.457683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] PATH_INFO: `/v3/projects/862d50dfde84423d9909344ed4f8c6d6/users/edb2125c4d8e4dda90ba598dfb63e2b1/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.472793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] RBAC: Authorizing `identity:create_grant(project_id=862d50dfde84423d9909344ed4f8c6d6, user_id=edb2125c4d8e4dda90ba598dfb63e2b1, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.475450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.487864 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1267/2547] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:46 2021] PUT /identity/v3/projects/862d50dfde84423d9909344ed4f8c6d6/users/edb2125c4d8e4dda90ba598dfb63e2b1/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:54:46.491834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.501442 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3ef9a-4661-4a03-ad5a-4c25a8b9a93b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.554073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8158c-3f2f-4f1b-af3f-9dc1bd781ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.554735 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8158c-3f2f-4f1b-af3f-9dc1bd781ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.555025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8158c-3f2f-4f1b-af3f-9dc1bd781ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.555302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8158c-3f2f-4f1b-af3f-9dc1bd781ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.556053 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8158c-3f2f-4f1b-af3f-9dc1bd781ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.557676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8158c-3f2f-4f1b-af3f-9dc1bd781ebb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.567719 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1281/2548] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:54:46.571969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.582539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ec2d6-49f1-4474-9014-45cee01f308e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.587124 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.587998 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.588283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.588558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] PATH_INFO: `/v3/projects/862d50dfde84423d9909344ed4f8c6d6/users/edb2125c4d8e4dda90ba598dfb63e2b1/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.590576 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=862d50dfde84423d9909344ed4f8c6d6, user_id=edb2125c4d8e4dda90ba598dfb63e2b1, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.594208 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.604752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1268/2549] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:54:46 2021] PUT /identity/v3/projects/862d50dfde84423d9909344ed4f8c6d6/users/edb2125c4d8e4dda90ba598dfb63e2b1/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:54:46.616101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037f64-7b25-4171-81bc-cb0a06c3aca9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.616396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037f64-7b25-4171-81bc-cb0a06c3aca9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.616672 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037f64-7b25-4171-81bc-cb0a06c3aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.642618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-83037f64-7b25-4171-81bc-cb0a06c3aca9 None None] MFA Rules not processed for user `edb2125c4d8e4dda90ba598dfb63e2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:46.643818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-83037f64-7b25-4171-81bc-cb0a06c3aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.712637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1282/2550] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:46 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:54:46.722885 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:46.724572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:46.778021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc00cb5-32d7-4b42-9430-9dad8b1eac1b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:46.781741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcb2c8-6334-4df0-8771-b6a6d402963a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:46.782370 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb2c8-6334-4df0-8771-b6a6d402963a service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:46.782659 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb2c8-6334-4df0-8771-b6a6d402963a service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:46.782940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb2c8-6334-4df0-8771-b6a6d402963a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:46.836194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcb2c8-6334-4df0-8771-b6a6d402963a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:46.837602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcb2c8-6334-4df0-8771-b6a6d402963a service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:46.846567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1269/2551] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:46 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:52.427811 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037f64-7b25-4171-81bc-cb0a06c3aca9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:54:52.437141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83037f64-7b25-4171-81bc-cb0a06c3aca9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:54:52.440674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:54:52.441311 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:52.441624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:52.441905 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:52.450455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:54:52.452428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:54:52.461582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1283/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:54:52 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:54:52.583089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e75a2-8311-4c46-93ec-80da8ad6564d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:54:52.583627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e75a2-8311-4c46-93ec-80da8ad6564d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:54:52.583729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e75a2-8311-4c46-93ec-80da8ad6564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:54:52.601189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f41e75a2-8311-4c46-93ec-80da8ad6564d None None] MFA Rules not processed for user `f23ed6c54b9f47ffb4a2cef5503d5396`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:54:52.602409 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f41e75a2-8311-4c46-93ec-80da8ad6564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:54:52.655965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1270/2553] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:54:52 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:17.000648 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:17.060101 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f3a14-dd30-43bc-9d85-7fd58940e934 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:17.065260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:17.066146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:17.066430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:17.066706 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] PATH_INFO: `/v3/users/9871b0228162407da3d5ebcfff0fa7a1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:17.067903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9871b0228162407da3d5ebcfff0fa7a1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:17.069850 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:17.112769 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9871b0228162407da3d5ebcfff0fa7a1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.119645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9871b0228162407da3d5ebcfff0fa7a1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.126823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9871b0228162407da3d5ebcfff0fa7a1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.127457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9871b0228162407da3d5ebcfff0fa7a1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.138592 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9871b0228162407da3d5ebcfff0fa7a1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.144242 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1284/2554] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:16 2021] DELETE /identity/v3/users/9871b0228162407da3d5ebcfff0fa7a1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:17.148935 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:17.149468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:17.149578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:17.166580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:17.167776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:17.224170 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1271/2555] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:17.234687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:17.236224 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:17.291932 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934651d-fa55-43d2-9c81-002d758a3d59 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:17.296498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:17.297123 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:17.297449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:17.297733 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:17.307268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:17.308694 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:17.318574 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1285/2556] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:17.570611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:17.572079 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:17.587195 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1f42c-184d-41cf-a671-0f28dd12cae1 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:17.592191 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:17.593678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:17.593960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:17.594538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] PATH_INFO: `/v3/projects/5a24dd6aa4e846c5aff9114f2e41fed7` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:17.595779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a24dd6aa4e846c5aff9114f2e41fed7)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:17.597741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:17.642525 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a24dd6aa4e846c5aff9114f2e41fed7', 'request_id': 'req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.650052 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a24dd6aa4e846c5aff9114f2e41fed7', 'request_id': 'req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.657165 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a24dd6aa4e846c5aff9114f2e41fed7', 'request_id': 'req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.666806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] The token cache is being invalidate because project 5a24dd6aa4e846c5aff9114f2e41fed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:17.667091 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.667783 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.669345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1272/2557] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:17 2021] DELETE /identity/v3/projects/5a24dd6aa4e846c5aff9114f2e41fed7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:17.674067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:17.683279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bbe6-8ad3-476e-9254-84ef4e3d4d77 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:17.737756 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:17.738630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:17.738915 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:17.739192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] PATH_INFO: `/v3/users/edb2125c4d8e4dda90ba598dfb63e2b1` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:17.740453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb2125c4d8e4dda90ba598dfb63e2b1)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:17.742387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:17.793612 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb2125c4d8e4dda90ba598dfb63e2b1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.801460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb2125c4d8e4dda90ba598dfb63e2b1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.808492 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb2125c4d8e4dda90ba598dfb63e2b1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.809155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb2125c4d8e4dda90ba598dfb63e2b1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.820437 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-b47d1ef3-b2ef-495d-87f0-c20b2217cf62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb2125c4d8e4dda90ba598dfb63e2b1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:17.826196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1286/2558] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:17 2021] DELETE /identity/v3/users/edb2125c4d8e4dda90ba598dfb63e2b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:18.192536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.194152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:18.209615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9696-8f24-4e2a-b7c9-58a049ecb4b0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.266649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.267549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.267838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.268120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] PATH_INFO: `/v3/projects/862d50dfde84423d9909344ed4f8c6d6` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.269378 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=862d50dfde84423d9909344ed4f8c6d6)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.271297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.315161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '862d50dfde84423d9909344ed4f8c6d6', 'request_id': 'req-96a80cba-d3ff-4dda-b048-11a1f0b23145'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.322597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '862d50dfde84423d9909344ed4f8c6d6', 'request_id': 'req-96a80cba-d3ff-4dda-b048-11a1f0b23145'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.329579 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '862d50dfde84423d9909344ed4f8c6d6', 'request_id': 'req-96a80cba-d3ff-4dda-b048-11a1f0b23145'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.339781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] The token cache is being invalidate because project 862d50dfde84423d9909344ed4f8c6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:18.340078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.340708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-96a80cba-d3ff-4dda-b048-11a1f0b23145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:18.342290 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1273/2559] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:18 2021] DELETE /identity/v3/projects/862d50dfde84423d9909344ed4f8c6d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:18.348380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b351-0553-40ab-9fd6-6bbadc5f757d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.349222 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b351-0553-40ab-9fd6-6bbadc5f757d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.349591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b351-0553-40ab-9fd6-6bbadc5f757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.367206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6a41b351-0553-40ab-9fd6-6bbadc5f757d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:18.368430 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6a41b351-0553-40ab-9fd6-6bbadc5f757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:18.426514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1287/2560] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:18.434507 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4729-9706-46f0-861e-d75de605564d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.434731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4729-9706-46f0-861e-d75de605564d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.435045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4729-9706-46f0-861e-d75de605564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.454131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-57cf4729-9706-46f0-861e-d75de605564d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:18.455330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-57cf4729-9706-46f0-861e-d75de605564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:18.463143 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1274/2561] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:18.467405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b351-0553-40ab-9fd6-6bbadc5f757d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.477092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b351-0553-40ab-9fd6-6bbadc5f757d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.481675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.482318 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.482603 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.482883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.483676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:55:18.483981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.485618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.496782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1288/2562] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:55:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:55:18.501721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4729-9706-46f0-861e-d75de605564d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.510693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4729-9706-46f0-861e-d75de605564d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.516177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.516812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.517094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.517486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.518192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.520056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.548792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1275/2563] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:18.549943 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.559618 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64929-7725-4f5b-9f3d-c855e514d163 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.613463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.614109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.614391 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.614669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.615383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.617256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.638439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1289/2564] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:55:18.639602 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.649469 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb2637-8534-4919-9147-4d35a4a446a4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.654031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.654680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.654959 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.655234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.655965 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.657565 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.668615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1276/2565] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:18 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:55:18.672863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.682298 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2e4e-c247-4e77-b116-6aabef8c519d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.687568 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286510e-6977-4cbf-96f4-2b6b4265b909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.688141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286510e-6977-4cbf-96f4-2b6b4265b909 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.688423 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286510e-6977-4cbf-96f4-2b6b4265b909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.688699 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286510e-6977-4cbf-96f4-2b6b4265b909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.689462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286510e-6977-4cbf-96f4-2b6b4265b909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.691043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286510e-6977-4cbf-96f4-2b6b4265b909 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.700555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1290/2566] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:18 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:18.704588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.714169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c216c-4f18-4775-81d7-40a9d396a7dc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.718859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.719983 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.720265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.720538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] PATH_INFO: `/v3/projects/b817b9e3cddd40928c08092a3bfdd157/users/381fec5be10648b4ae66de4a9c0d92cc/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.735010 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b817b9e3cddd40928c08092a3bfdd157, user_id=381fec5be10648b4ae66de4a9c0d92cc, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.737680 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.751005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1277/2567] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:18 2021] PUT /identity/v3/projects/b817b9e3cddd40928c08092a3bfdd157/users/381fec5be10648b4ae66de4a9c0d92cc/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:18.761912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af504d-cb2b-417f-a752-6e617a9235b9 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.762206 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af504d-cb2b-417f-a752-6e617a9235b9 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.762487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af504d-cb2b-417f-a752-6e617a9235b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.790412 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-16af504d-cb2b-417f-a752-6e617a9235b9 None None] MFA Rules not processed for user `381fec5be10648b4ae66de4a9c0d92cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:18.791705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-16af504d-cb2b-417f-a752-6e617a9235b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:18.854519 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1291/2568] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:18.859584 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.917974 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc5f8b-f810-44fb-aa00-3b47dbf2b38b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:18.923411 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:18.924062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:18.924345 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:18.924620 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:18.925323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:18.927238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:18.951736 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1278/2569] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:18.956470 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af504d-cb2b-417f-a752-6e617a9235b9 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:18.967012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af504d-cb2b-417f-a752-6e617a9235b9 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.021205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.021902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.022195 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.022479 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.023192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.025094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.044429 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1292/2570] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:18 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:19.048969 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.058804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010cab-d8f7-4b15-8c96-d5286e15ced3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.063487 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.064131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.064413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.064690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.065446 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.067030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.077265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1279/2571] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:19.081432 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.091411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95acf5-064c-4867-96c9-f3f4c99710a0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.096891 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.097817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.098105 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.098389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] PATH_INFO: `/v3/projects/6fa98b40ba6d47f18160dd18c7e22b21/users/3d507ed095664956a31a658b3ad3f967/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.113658 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa98b40ba6d47f18160dd18c7e22b21, user_id=3d507ed095664956a31a658b3ad3f967, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.116291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.128235 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1293/2572] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:19 2021] PUT /identity/v3/projects/6fa98b40ba6d47f18160dd18c7e22b21/users/3d507ed095664956a31a658b3ad3f967/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:19.132144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.141883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f65a7-b4d0-4973-9cde-8034ccba1870 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.195054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a9268-a5dc-4f9c-9e25-44e4d9981032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.195733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a9268-a5dc-4f9c-9e25-44e4d9981032 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.196017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a9268-a5dc-4f9c-9e25-44e4d9981032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.196297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a9268-a5dc-4f9c-9e25-44e4d9981032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.197024 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a9268-a5dc-4f9c-9e25-44e4d9981032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.198630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a9268-a5dc-4f9c-9e25-44e4d9981032 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.208430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1280/2573] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:19 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:19.212556 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.223378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcea69f-4a64-4b94-b65d-368fe20edd49 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.227976 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.228840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.229128 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.229450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] PATH_INFO: `/v3/projects/6fa98b40ba6d47f18160dd18c7e22b21/users/3d507ed095664956a31a658b3ad3f967/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.231455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa98b40ba6d47f18160dd18c7e22b21, user_id=3d507ed095664956a31a658b3ad3f967, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.234714 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.244869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1294/2574] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:19 2021] PUT /identity/v3/projects/6fa98b40ba6d47f18160dd18c7e22b21/users/3d507ed095664956a31a658b3ad3f967/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:19.254725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649961-c42a-43a8-8665-a9f11332e241 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.255021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649961-c42a-43a8-8665-a9f11332e241 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.255302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649961-c42a-43a8-8665-a9f11332e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.280846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-23649961-c42a-43a8-8665-a9f11332e241 None None] MFA Rules not processed for user `3d507ed095664956a31a658b3ad3f967`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:19.282095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-23649961-c42a-43a8-8665-a9f11332e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:19.348614 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1281/2575] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:19 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:19.359817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.361584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:19.416208 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8ec02-6d3e-49ff-8704-402f7a907d77 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.420030 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.420662 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.420972 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.421252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.430114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.431551 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.440884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1295/2576] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:19 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:19.725890 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649961-c42a-43a8-8665-a9f11332e241 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.734924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649961-c42a-43a8-8665-a9f11332e241 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.739540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d507ed095664956a31a658b3ad3f967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa98b40ba6d47f18160dd18c7e22b21', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.740186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.740481 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.740766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.741543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:55:19.741855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.743445 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.755495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1282/2577] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:55:19.759614 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.768968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc6b0a-bd25-4ea8-8b55-010c3c98bf65 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.773547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d507ed095664956a31a658b3ad3f967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa98b40ba6d47f18160dd18c7e22b21', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.774182 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.774473 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.774752 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.775451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.777320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.800621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1296/2578] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:19 2021] POST /identity/v3/projects => generated 353 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:19.804825 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.815053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659740-6483-4dcb-b2e3-f9c6ddfb16ff tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.868805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d507ed095664956a31a658b3ad3f967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa98b40ba6d47f18160dd18c7e22b21', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.869491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.869789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.870070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.870805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:55:19.871120 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.872696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.884582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1283/2579] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:55:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:55:19.918155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:19.928257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610490e-ac7e-42ad-8edf-d451b45c6f5a tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:19.932902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3d507ed095664956a31a658b3ad3f967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa98b40ba6d47f18160dd18c7e22b21', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:19.933786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:19.934077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:19.934357 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] PATH_INFO: `/v3/projects/641e1d24b3dd4247aa8ca173a8fc9f66` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:19.935544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorizing `identity:delete_project(project_id=641e1d24b3dd4247aa8ca173a8fc9f66)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:19.937987 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:19.983314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641e1d24b3dd4247aa8ca173a8fc9f66', 'request_id': 'req-d1b49c42-bd37-46a0-83a8-746c6efa79c1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:19.989883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641e1d24b3dd4247aa8ca173a8fc9f66', 'request_id': 'req-d1b49c42-bd37-46a0-83a8-746c6efa79c1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:19.996389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641e1d24b3dd4247aa8ca173a8fc9f66', 'request_id': 'req-d1b49c42-bd37-46a0-83a8-746c6efa79c1'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.007072 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] The token cache is being invalidate because project 641e1d24b3dd4247aa8ca173a8fc9f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:20.007364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.008023 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-d1b49c42-bd37-46a0-83a8-746c6efa79c1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.009569 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1297/2580] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:19 2021] DELETE /identity/v3/projects/641e1d24b3dd4247aa8ca173a8fc9f66 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:20.179567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:20.181342 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:20.244302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc9a71-5d28-4fb5-849d-5436803d66f1 tempest-VolumeQuotaClassesTest-381697152 tempest-VolumeQuotaClassesTest-381697152-project-admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:20.297343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:20.298226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:20.298514 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:20.298792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] PATH_INFO: `/v3/users/381fec5be10648b4ae66de4a9c0d92cc` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:20.299987 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381fec5be10648b4ae66de4a9c0d92cc)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:20.302072 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:20.345012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381fec5be10648b4ae66de4a9c0d92cc'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.345738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381fec5be10648b4ae66de4a9c0d92cc'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.352609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381fec5be10648b4ae66de4a9c0d92cc'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.360158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381fec5be10648b4ae66de4a9c0d92cc'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.360790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381fec5be10648b4ae66de4a9c0d92cc'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.380569 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1284/2581] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:20 2021] DELETE /identity/v3/users/381fec5be10648b4ae66de4a9c0d92cc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:20.385084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:20.385686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:20.385686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:20.402112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:20.403295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:20.458721 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1298/2582] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:20.468930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:20.470638 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:20.526486 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291218e-7c5d-4160-8268-998f43eb9229 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:20.530607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:20.531252 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:20.531538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:20.531817 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:20.540548 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:20.542017 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:20.551749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1285/2583] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:20.805678 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:20.807095 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:20.818941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1004188-4d0b-4311-b2b0-550dacc1f440 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:20.823535 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:20.824388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:20.824679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:20.824955 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] PATH_INFO: `/v3/projects/b817b9e3cddd40928c08092a3bfdd157` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:20.826220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b817b9e3cddd40928c08092a3bfdd157)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:20.828715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:20.874042 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b817b9e3cddd40928c08092a3bfdd157', 'request_id': 'req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.880875 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b817b9e3cddd40928c08092a3bfdd157', 'request_id': 'req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.887515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b817b9e3cddd40928c08092a3bfdd157', 'request_id': 'req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.897945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] The token cache is being invalidate because project b817b9e3cddd40928c08092a3bfdd157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:20.898234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.898879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:20.900380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1299/2584] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:20 2021] DELETE /identity/v3/projects/b817b9e3cddd40928c08092a3bfdd157 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:20.904495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:20.914727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503eb42-b666-49e0-ad17-c9c4fd76cc54 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:20.971291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:20.972158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:20.972449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:20.972746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] PATH_INFO: `/v3/users/3d507ed095664956a31a658b3ad3f967` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:20.973972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d507ed095664956a31a658b3ad3f967)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:20.975910 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.019733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d507ed095664956a31a658b3ad3f967'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.020392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d507ed095664956a31a658b3ad3f967'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.027526 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d507ed095664956a31a658b3ad3f967'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.034728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d507ed095664956a31a658b3ad3f967'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.035359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-12cdd633-cefc-40c0-b558-42e45a2419f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d507ed095664956a31a658b3ad3f967'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.051560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1286/2585] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:20 2021] DELETE /identity/v3/users/3d507ed095664956a31a658b3ad3f967 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:55:21.308625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:21.310216 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:21.326474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1deaf4-9145-42e9-b20b-0d7bfd2344cf admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:21.387653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:21.388508 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.389026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.389156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] PATH_INFO: `/v3/projects/6fa98b40ba6d47f18160dd18c7e22b21` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.390912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa98b40ba6d47f18160dd18c7e22b21)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:21.392822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.436021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa98b40ba6d47f18160dd18c7e22b21', 'request_id': 'req-21d19143-a073-452d-85b6-0517d394644b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.443118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa98b40ba6d47f18160dd18c7e22b21', 'request_id': 'req-21d19143-a073-452d-85b6-0517d394644b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.449067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa98b40ba6d47f18160dd18c7e22b21', 'request_id': 'req-21d19143-a073-452d-85b6-0517d394644b'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.459471 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] The token cache is being invalidate because project 6fa98b40ba6d47f18160dd18c7e22b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:21.459761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.460387 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-21d19143-a073-452d-85b6-0517d394644b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:21.461936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1300/2586] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:21 2021] DELETE /identity/v3/projects/6fa98b40ba6d47f18160dd18c7e22b21 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:21.468092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26934b1-efc9-4e3d-89af-32974b688d1b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.468573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26934b1-efc9-4e3d-89af-32974b688d1b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.468672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26934b1-efc9-4e3d-89af-32974b688d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.485970 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c26934b1-efc9-4e3d-89af-32974b688d1b None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:21.487178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c26934b1-efc9-4e3d-89af-32974b688d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:21.543695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1287/2587] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:21.552237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc94c6-7576-40f6-9487-87a860e64b89 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.552527 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc94c6-7576-40f6-9487-87a860e64b89 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.552807 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc94c6-7576-40f6-9487-87a860e64b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.571024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-58dc94c6-7576-40f6-9487-87a860e64b89 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:21.572146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-58dc94c6-7576-40f6-9487-87a860e64b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:21.579868 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1301/2588] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:21.583952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26934b1-efc9-4e3d-89af-32974b688d1b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:21.593464 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26934b1-efc9-4e3d-89af-32974b688d1b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:21.598323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:21.598963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.599249 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.599531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.600288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:55:21.600597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:21.602224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.613852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1288/2589] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:55:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:55:21.617843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc94c6-7576-40f6-9487-87a860e64b89 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:21.627345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc94c6-7576-40f6-9487-87a860e64b89 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:21.633223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:21.634398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.634908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.635421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.636746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:21.640431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.673536 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1302/2590] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:21 2021] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:21.677703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:21.688193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f7f85-944f-4097-b4bd-55acd0ff8e80 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:21.742616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:21.743276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.743564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.743848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.744555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:21.746504 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.766101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1289/2591] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:21 2021] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:21.770389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:21.780650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb464cd0-9f37-4306-9ab9-3259147ee033 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:21.785268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:21.785951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.786237 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.786514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.787270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:21.788844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.799652 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1303/2592] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:21 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:21.803535 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:21.813923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674ab6b-a49c-4578-ad45-187b8b2d4e7b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:21.818574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1082493-fa1d-4742-96b1-88bedba2a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:21.819224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1082493-fa1d-4742-96b1-88bedba2a74d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.819513 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1082493-fa1d-4742-96b1-88bedba2a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.819795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1082493-fa1d-4742-96b1-88bedba2a74d admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.820523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1082493-fa1d-4742-96b1-88bedba2a74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:21.822244 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1082493-fa1d-4742-96b1-88bedba2a74d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.831844 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1290/2593] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:21 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:21.835828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:21.845798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dda0-8cf0-416a-b46c-866de4e7b3b7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:21.850362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:21.851219 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.851506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.851786 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] PATH_INFO: `/v3/projects/7ccfa0375c9440f3907fc770c211472c/users/cd116de42c4a4f68856e4ba17c4ac6cc/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.866080 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ccfa0375c9440f3907fc770c211472c, user_id=cd116de42c4a4f68856e4ba17c4ac6cc, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:21.868691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:21.881548 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1304/2594] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:21 2021] PUT /identity/v3/projects/7ccfa0375c9440f3907fc770c211472c/users/cd116de42c4a4f68856e4ba17c4ac6cc/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:55:21.892591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06c89-ac61-4bdc-96b1-8c69791d5d56 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:21.892888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06c89-ac61-4bdc-96b1-8c69791d5d56 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:21.893197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06c89-ac61-4bdc-96b1-8c69791d5d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:21.919101 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-1fa06c89-ac61-4bdc-96b1-8c69791d5d56 None None] MFA Rules not processed for user `cd116de42c4a4f68856e4ba17c4ac6cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:21.920316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1fa06c89-ac61-4bdc-96b1-8c69791d5d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:21.983303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1291/2595] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:21 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:21.988082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.046455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd27d59-b41b-473c-91f3-decb91946a0f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.051124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.051777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.052067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.052351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.053061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.054992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.078992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1305/2596] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:21 2021] POST /identity/v3/projects => generated 401 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:22.082933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa06c89-ac61-4bdc-96b1-8c69791d5d56 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.093961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa06c89-ac61-4bdc-96b1-8c69791d5d56 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.146456 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.147139 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.147427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.147708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.148412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.150358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.169521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1292/2597] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:22 2021] POST /identity/v3/users => generated 307 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:22.174274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.184586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc660f64-a295-432c-9643-cda00856c543 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.189392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.190324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.190611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.190892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.191630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.193500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.203885 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1306/2598] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:22.208012 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.218147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62a36e-2b85-400e-ac83-32e72fbdf8dd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.222894 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.223749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.224030 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.224306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] PATH_INFO: `/v3/projects/0bf6e4ea7b7b4089bc93f90d9b53b1d8/users/abf52ad5b3644b5cbcea56746b55f7c2/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.238809 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf6e4ea7b7b4089bc93f90d9b53b1d8, user_id=abf52ad5b3644b5cbcea56746b55f7c2, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.241460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.253846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1293/2599] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:22 2021] PUT /identity/v3/projects/0bf6e4ea7b7b4089bc93f90d9b53b1d8/users/abf52ad5b3644b5cbcea56746b55f7c2/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:55:22.257709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.267351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853e03d-0fbc-44d2-a9cf-d69c353d52a1 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.321918 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff41c7-5a1e-401d-9aab-319c2a7a3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.322571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff41c7-5a1e-401d-9aab-319c2a7a3477 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.322857 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff41c7-5a1e-401d-9aab-319c2a7a3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.323133 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff41c7-5a1e-401d-9aab-319c2a7a3477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.323853 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff41c7-5a1e-401d-9aab-319c2a7a3477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.325449 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff41c7-5a1e-401d-9aab-319c2a7a3477 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.335769 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1307/2600] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:22.339819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.350533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658a59b-22ab-41a6-a06b-3faeebfdc697 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.355081 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.355940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.356221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.356495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] PATH_INFO: `/v3/projects/0bf6e4ea7b7b4089bc93f90d9b53b1d8/users/abf52ad5b3644b5cbcea56746b55f7c2/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.358582 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf6e4ea7b7b4089bc93f90d9b53b1d8, user_id=abf52ad5b3644b5cbcea56746b55f7c2, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.361178 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.370902 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1294/2601] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:22 2021] PUT /identity/v3/projects/0bf6e4ea7b7b4089bc93f90d9b53b1d8/users/abf52ad5b3644b5cbcea56746b55f7c2/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:55:22.380797 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e701f-a6e4-4e93-8540-41b313b2a0ab None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.381092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e701f-a6e4-4e93-8540-41b313b2a0ab None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.381392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e701f-a6e4-4e93-8540-41b313b2a0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.407950 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-522e701f-a6e4-4e93-8540-41b313b2a0ab None None] MFA Rules not processed for user `abf52ad5b3644b5cbcea56746b55f7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:22.409147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-522e701f-a6e4-4e93-8540-41b313b2a0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:22.473340 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1308/2602] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:22 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:22.482924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.484637 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:22.538003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcbdbb-c0e1-469c-984b-02ad7c131b5a admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.541815 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cfa95-f6b6-4f68-8ace-b700a1893332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.542450 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfa95-f6b6-4f68-8ace-b700a1893332 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.542733 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfa95-f6b6-4f68-8ace-b700a1893332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.543009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cfa95-f6b6-4f68-8ace-b700a1893332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.551765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cfa95-f6b6-4f68-8ace-b700a1893332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.553169 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cfa95-f6b6-4f68-8ace-b700a1893332 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.562276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1295/2603] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:22 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:22.633265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e701f-a6e4-4e93-8540-41b313b2a0ab None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:22.643205 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e701f-a6e4-4e93-8540-41b313b2a0ab None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:22.646822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:22.647460 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:22.647748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:22.648028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:22.703160 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:22.704589 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:22.714654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1309/2604] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:22 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:25.602502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc5cb-4305-4aef-aa36-2270a1caba0c None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:25.603009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc5cb-4305-4aef-aa36-2270a1caba0c None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:25.603232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bc5cb-4305-4aef-aa36-2270a1caba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:25.620005 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-df6bc5cb-4305-4aef-aa36-2270a1caba0c None None] MFA Rules not processed for user `f23ed6c54b9f47ffb4a2cef5503d5396`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:25.621180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-df6bc5cb-4305-4aef-aa36-2270a1caba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:25.675473 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1296/2605] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:25 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:26.672768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:26.736480 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984568cb-fb9a-4abc-929f-d5a0a7882e38 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:26.741064 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:26.742091 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:26.742376 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:26.742653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] PATH_INFO: `/v3/users/cd116de42c4a4f68856e4ba17c4ac6cc` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:26.743845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd116de42c4a4f68856e4ba17c4ac6cc)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:26.745826 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:26.789202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd116de42c4a4f68856e4ba17c4ac6cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:26.796843 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd116de42c4a4f68856e4ba17c4ac6cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:26.803468 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd116de42c4a4f68856e4ba17c4ac6cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:26.804158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd116de42c4a4f68856e4ba17c4ac6cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:26.815653 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd116de42c4a4f68856e4ba17c4ac6cc'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:26.821600 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1310/2606] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:26 2021] DELETE /identity/v3/users/cd116de42c4a4f68856e4ba17c4ac6cc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:26.826159 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:26.826626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:26.826720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:26.844618 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:26.845836 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:26.902402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1297/2607] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:26.912268 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:26.913738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:26.967983 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08b5d9-182a-46f1-9af1-97242b2dce1c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:26.971863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:26.972499 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:26.972780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:26.973057 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:26.981776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:26.983193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:26.992784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1311/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:27.339558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:27.341188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:27.354348 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a539f5a-f1f0-415d-890c-1dec95567cd7 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:27.359750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:27.360853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:27.361633 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:27.362129 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] PATH_INFO: `/v3/projects/7ccfa0375c9440f3907fc770c211472c` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:27.363748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ccfa0375c9440f3907fc770c211472c)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:27.366330 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:27.416393 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ccfa0375c9440f3907fc770c211472c', 'request_id': 'req-11964961-e460-44c0-b086-fc922514f3c2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.424302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ccfa0375c9440f3907fc770c211472c', 'request_id': 'req-11964961-e460-44c0-b086-fc922514f3c2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.430452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ccfa0375c9440f3907fc770c211472c', 'request_id': 'req-11964961-e460-44c0-b086-fc922514f3c2'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.440499 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] The token cache is being invalidate because project 7ccfa0375c9440f3907fc770c211472c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:27.440832 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.441520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.443262 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1298/2609] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:27 2021] DELETE /identity/v3/projects/7ccfa0375c9440f3907fc770c211472c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:27.447143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:27.456715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9f695-c056-4efc-bc41-09d96fc184e0 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:27.515629 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:27.516611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:27.516959 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:27.517301 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] PATH_INFO: `/v3/users/abf52ad5b3644b5cbcea56746b55f7c2` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:27.518590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf52ad5b3644b5cbcea56746b55f7c2)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:27.520563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:27.566565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf52ad5b3644b5cbcea56746b55f7c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.573796 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf52ad5b3644b5cbcea56746b55f7c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.580979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf52ad5b3644b5cbcea56746b55f7c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.581647 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf52ad5b3644b5cbcea56746b55f7c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.593946 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-0a0cef2e-fb3f-4609-81fb-6a36925edae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf52ad5b3644b5cbcea56746b55f7c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:27.600191 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1312/2610] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:27 2021] DELETE /identity/v3/users/abf52ad5b3644b5cbcea56746b55f7c2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:27.869449 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:27.871563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:27.894268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964961-e460-44c0-b086-fc922514f3c2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:27.965909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:27.966821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:27.967112 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:27.967388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] PATH_INFO: `/v3/projects/0bf6e4ea7b7b4089bc93f90d9b53b1d8` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:27.969851 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf6e4ea7b7b4089bc93f90d9b53b1d8)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:27.971766 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.026266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf6e4ea7b7b4089bc93f90d9b53b1d8', 'request_id': 'req-e43ea5ed-6807-4a03-92bf-62796c325eb8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:28.036560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf6e4ea7b7b4089bc93f90d9b53b1d8', 'request_id': 'req-e43ea5ed-6807-4a03-92bf-62796c325eb8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:28.042972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf6e4ea7b7b4089bc93f90d9b53b1d8', 'request_id': 'req-e43ea5ed-6807-4a03-92bf-62796c325eb8'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:28.054853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] The token cache is being invalidate because project 0bf6e4ea7b7b4089bc93f90d9b53b1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:28.055226 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:28.055893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-e43ea5ed-6807-4a03-92bf-62796c325eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:28.057730 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1299/2611] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:27 2021] DELETE /identity/v3/projects/0bf6e4ea7b7b4089bc93f90d9b53b1d8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:28.064725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb15ce-1512-4a3c-99ed-2efa92111c6c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.066092 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb15ce-1512-4a3c-99ed-2efa92111c6c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.066380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb15ce-1512-4a3c-99ed-2efa92111c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.087635 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-d0eb15ce-1512-4a3c-99ed-2efa92111c6c None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:28.088979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-d0eb15ce-1512-4a3c-99ed-2efa92111c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:28.162869 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1313/2612] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:28.172381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57c518-2146-4c53-8fcd-2a41291f6bdb None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.172667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57c518-2146-4c53-8fcd-2a41291f6bdb None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.172942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57c518-2146-4c53-8fcd-2a41291f6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.192536 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-3e57c518-2146-4c53-8fcd-2a41291f6bdb None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:28.193796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3e57c518-2146-4c53-8fcd-2a41291f6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:28.201868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1300/2613] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:28.206450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb15ce-1512-4a3c-99ed-2efa92111c6c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:28.216081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb15ce-1512-4a3c-99ed-2efa92111c6c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:28.221620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:28.222295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.222550 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.222823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.223847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:55:28.223847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:28.225462 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.237539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1314/2614] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:55:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:55:28.243460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57c518-2146-4c53-8fcd-2a41291f6bdb None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:28.252338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57c518-2146-4c53-8fcd-2a41291f6bdb None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:28.257064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:28.257769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.258053 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.258329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.259033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:28.260899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.288940 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1301/2615] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:28 2021] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:28.290116 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:28.300996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cdd57-2ba0-451d-92bd-53a80d75be1c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:28.360738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:28.361436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.361725 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.362008 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.362718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:28.364626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.387131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1315/2616] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:28 2021] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:28.388301 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:28.401500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79580bb5-1753-437b-aab4-7a66b4e60c2b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:28.409158 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:28.409952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.410240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.410519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.412672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:28.412926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.427925 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1302/2617] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:28 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:28.429215 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:28.440230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebda6a-0081-47fc-b7a8-3b3189439691 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:28.444969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced1141-28e2-466f-80c8-7b034cef7ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:28.445668 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1141-28e2-466f-80c8-7b034cef7ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.445981 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1141-28e2-466f-80c8-7b034cef7ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.446258 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced1141-28e2-466f-80c8-7b034cef7ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.447017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1141-28e2-466f-80c8-7b034cef7ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:28.448590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced1141-28e2-466f-80c8-7b034cef7ad5 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.462555 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1316/2618] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:28.463701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:28.474533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3c3ef-8fc6-4937-a59f-23d6dae464af admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:28.479776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:28.480221 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.480533 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.480812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] PATH_INFO: `/v3/projects/00a4ac701853439781062a4c6958ab4d/users/0289dc92319f4425824c8d3690c54041/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.495332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a4ac701853439781062a4c6958ab4d, user_id=0289dc92319f4425824c8d3690c54041, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:28.498009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.510867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1303/2619] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:28 2021] PUT /identity/v3/projects/00a4ac701853439781062a4c6958ab4d/users/0289dc92319f4425824c8d3690c54041/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:55:28.516491 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb8a7-a22a-4839-9299-f02eff701b3d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.516762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb8a7-a22a-4839-9299-f02eff701b3d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.517045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb8a7-a22a-4839-9299-f02eff701b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.535107 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-319eb8a7-a22a-4839-9299-f02eff701b3d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:28.536319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-319eb8a7-a22a-4839-9299-f02eff701b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:28.592591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1317/2620] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:28.604950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:28.608256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:28.664903 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12e9f-d1ea-4d3a-af8e-51b5c430f0ac admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:28.668751 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:28.669671 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:28.670062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:28.670340 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:28.680803 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:28.682408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:28.699928 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1304/2621] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:55:29.321115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308f1c-32cf-4356-8a26-468eae512442 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:29.321650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308f1c-32cf-4356-8a26-468eae512442 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:29.321746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308f1c-32cf-4356-8a26-468eae512442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:29.351289 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c3308f1c-32cf-4356-8a26-468eae512442 None None] MFA Rules not processed for user `0289dc92319f4425824c8d3690c54041`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:29.352858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c3308f1c-32cf-4356-8a26-468eae512442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:29.419830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1318/2622] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:29 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:29.425971 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:29.433792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c45b7-c828-4369-a147-e68da468da80 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:29.439202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:29.439849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:29.440134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:29.440412 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:29.441127 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:29.443064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:29.470385 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1305/2623] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:29 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:29.474534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308f1c-32cf-4356-8a26-468eae512442 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:29.485161 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308f1c-32cf-4356-8a26-468eae512442 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:29.544066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:29.544758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:29.545044 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:29.545323 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:29.546109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:29.548047 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:29.570315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1319/2624] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:29 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:29.574187 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:29.585320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bb32a-dea3-40d3-8d47-61d290178fc7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:29.590457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:29.592089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:29.592547 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:29.593004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:29.593962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:29.595997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:29.608701 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1306/2625] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:29 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:29.612910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:29.624424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b630ba-3c31-4ce8-b0b6-a4ca481721ad admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:29.629419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:29.630331 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:29.631049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:29.631049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] PATH_INFO: `/v3/projects/99c360d5c9144aceae691be02a105b0a/users/d759770b6c7c48cab37aa1decba36892/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:29.652424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c360d5c9144aceae691be02a105b0a, user_id=d759770b6c7c48cab37aa1decba36892, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:29.655780 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:29.670344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1320/2626] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:29 2021] PUT /identity/v3/projects/99c360d5c9144aceae691be02a105b0a/users/d759770b6c7c48cab37aa1decba36892/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:29.674527 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:29.684699 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dba73-9418-4536-9e5d-1a21bb829322 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:29.739586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd7e9-a945-440e-be80-5ad6e5ce2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:29.740255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd7e9-a945-440e-be80-5ad6e5ce2249 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:29.740543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd7e9-a945-440e-be80-5ad6e5ce2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:29.740823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd7e9-a945-440e-be80-5ad6e5ce2249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:29.741606 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd7e9-a945-440e-be80-5ad6e5ce2249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:29.743224 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd7e9-a945-440e-be80-5ad6e5ce2249 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:29.757066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1307/2627] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:29 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:29.758547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:29.770159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e65c4-5a10-41dc-9f49-0357c06c2524 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:29.774989 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:29.775887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:29.776171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:29.776447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] PATH_INFO: `/v3/projects/99c360d5c9144aceae691be02a105b0a/users/d759770b6c7c48cab37aa1decba36892/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:29.778620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c360d5c9144aceae691be02a105b0a, user_id=d759770b6c7c48cab37aa1decba36892, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:29.781330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:29.792485 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1321/2628] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:29 2021] PUT /identity/v3/projects/99c360d5c9144aceae691be02a105b0a/users/d759770b6c7c48cab37aa1decba36892/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:30.407719 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:30.408013 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:30.408294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:30.436944 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] MFA Rules not processed for user `d759770b6c7c48cab37aa1decba36892`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:30.438303 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:30.506438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1308/2629] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:30 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:30.518177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:30.519864 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:30.575886 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62922d-efc1-438f-b490-250b01ba93d7 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:30.579966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:30.580613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:30.580903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:30.581187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:30.635312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:30.636761 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:30.646160 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1322/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:30 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:31.969109 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:31.970824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:31.982522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0671eb-bbb5-4433-bd42-32ff7ee39366 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:31.986078 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:31.986706 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:31.986989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:31.987265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:31.995805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:31.997202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:32.007236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1309/2631] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:31 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:44.627812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:44.687009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a3448-7832-4605-b3ae-76cd33db28d6 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:44.691450 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:44.692300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:44.692584 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:44.692863 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] PATH_INFO: `/v3/users/0289dc92319f4425824c8d3690c54041` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:44.694069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0289dc92319f4425824c8d3690c54041)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:44.695969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:44.739086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0289dc92319f4425824c8d3690c54041'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:44.745939 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0289dc92319f4425824c8d3690c54041'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:44.752411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0289dc92319f4425824c8d3690c54041'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:44.753040 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0289dc92319f4425824c8d3690c54041'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:44.764963 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0289dc92319f4425824c8d3690c54041'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:44.770696 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1323/2632] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:44 2021] DELETE /identity/v3/users/0289dc92319f4425824c8d3690c54041 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:44.947421 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:44.958337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5560a75-b3bb-4b20-9f6f-5298eb623f7c service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.013549 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.014405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.015239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.015517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] PATH_INFO: `/v3/projects/00a4ac701853439781062a4c6958ab4d` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.016708 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a4ac701853439781062a4c6958ab4d)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.018635 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.062257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a4ac701853439781062a4c6958ab4d', 'request_id': 'req-5bb4aaeb-3242-4abd-8910-e4aae3547601'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.069141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a4ac701853439781062a4c6958ab4d', 'request_id': 'req-5bb4aaeb-3242-4abd-8910-e4aae3547601'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.075041 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a4ac701853439781062a4c6958ab4d', 'request_id': 'req-5bb4aaeb-3242-4abd-8910-e4aae3547601'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.085132 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] The token cache is being invalidate because project 00a4ac701853439781062a4c6958ab4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:45.085441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.086057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.087540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1310/2633] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:44 2021] DELETE /identity/v3/projects/00a4ac701853439781062a4c6958ab4d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:45.091565 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.093683 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:45.107698 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d23b2c-72af-40b0-b345-9a631b18f810 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.164636 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.165530 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.165819 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.166098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] PATH_INFO: `/v3/users/d759770b6c7c48cab37aa1decba36892` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.167285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d759770b6c7c48cab37aa1decba36892)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.169185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.216004 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd759770b6c7c48cab37aa1decba36892'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.223746 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd759770b6c7c48cab37aa1decba36892'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.230540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd759770b6c7c48cab37aa1decba36892'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.231194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd759770b6c7c48cab37aa1decba36892'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.244265 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-13d6afef-9d41-4fdf-b3c2-25d3665122b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd759770b6c7c48cab37aa1decba36892'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.250737 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1324/2634] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:45 2021] DELETE /identity/v3/users/d759770b6c7c48cab37aa1decba36892 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:45.420607 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.422044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:45.434317 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4aaeb-3242-4abd-8910-e4aae3547601 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.487835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.488682 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.488963 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.489236 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] PATH_INFO: `/v3/projects/99c360d5c9144aceae691be02a105b0a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.490455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c360d5c9144aceae691be02a105b0a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.492335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.535846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c360d5c9144aceae691be02a105b0a', 'request_id': 'req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.542544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c360d5c9144aceae691be02a105b0a', 'request_id': 'req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.549089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c360d5c9144aceae691be02a105b0a', 'request_id': 'req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.558958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] The token cache is being invalidate because project 99c360d5c9144aceae691be02a105b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:45.559245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.559922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c513a8c-8e0c-4428-bf6f-d5bc77c08108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:45.562285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1311/2635] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:45 2021] DELETE /identity/v3/projects/99c360d5c9144aceae691be02a105b0a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:45.568106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407e2c-f82d-4223-8a6b-af130668251d None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.568399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407e2c-f82d-4223-8a6b-af130668251d None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.568691 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407e2c-f82d-4223-8a6b-af130668251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.587113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ec407e2c-f82d-4223-8a6b-af130668251d None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:45.588312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ec407e2c-f82d-4223-8a6b-af130668251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:45.645543 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1325/2636] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:45.653463 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e463-4286-4bec-8b31-3bb1d7c1adac None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.653755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e463-4286-4bec-8b31-3bb1d7c1adac None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.654031 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9e463-4286-4bec-8b31-3bb1d7c1adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.672095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-f3f9e463-4286-4bec-8b31-3bb1d7c1adac None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:45.673276 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f3f9e463-4286-4bec-8b31-3bb1d7c1adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:45.680972 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1312/2637] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:45.685062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407e2c-f82d-4223-8a6b-af130668251d None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.694400 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407e2c-f82d-4223-8a6b-af130668251d None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.698988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.699566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.699854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.700131 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.700860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:55:45.701164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.703369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.714563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1326/2638] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:55:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:55:45.719177 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e463-4286-4bec-8b31-3bb1d7c1adac None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.728316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9e463-4286-4bec-8b31-3bb1d7c1adac None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.732919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.734138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.734417 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.734688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.735388 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.737251 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.763150 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1313/2639] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:55:45 2021] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:55:45.767369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.777200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0250-c1f0-4785-adc4-2a51e007dc8c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.830958 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.831623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.831909 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.832187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.832896 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.834828 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.853381 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1327/2640] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:55:45 2021] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:55:45.857691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.868261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1624d5-1d2b-4beb-85cd-9a46008311d6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.872933 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.873611 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.873923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.874757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.875483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.877094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.887114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1314/2641] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:45.891214 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.900969 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b48f6-6e7c-4612-8a92-ab536c551bff admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.906190 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6be19-3202-4316-b172-02e3c4d3665f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.906829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6be19-3202-4316-b172-02e3c4d3665f admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.907111 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6be19-3202-4316-b172-02e3c4d3665f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.907388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6be19-3202-4316-b172-02e3c4d3665f admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.908109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6be19-3202-4316-b172-02e3c4d3665f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.909697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6be19-3202-4316-b172-02e3c4d3665f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.919373 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1328/2642] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:55:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:55:45.923865 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:45.933938 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cbe6a-0984-4440-9682-789a6671ded6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:45.938731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:45.939658 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.939939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.940216 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] PATH_INFO: `/v3/projects/2d090b1d654b47668aa54de7bab9a2e3/users/71918fb5ce55441e81d720cfb705cf18/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:45.954560 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d090b1d654b47668aa54de7bab9a2e3, user_id=71918fb5ce55441e81d720cfb705cf18, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:45.957164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:45.972352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1315/2643] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:55:45 2021] PUT /identity/v3/projects/2d090b1d654b47668aa54de7bab9a2e3/users/71918fb5ce55441e81d720cfb705cf18/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:45.982623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f71c-b7ae-4f9c-ab33-f245f5aeb9d3 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:45.982916 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f71c-b7ae-4f9c-ab33-f245f5aeb9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:45.983201 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800f71c-b7ae-4f9c-ab33-f245f5aeb9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:46.010359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-6800f71c-b7ae-4f9c-ab33-f245f5aeb9d3 None None] MFA Rules not processed for user `71918fb5ce55441e81d720cfb705cf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:46.011644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-6800f71c-b7ae-4f9c-ab33-f245f5aeb9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:46.074831 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1329/2644] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:45 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:55:46.084775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:46.086512 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:46.158744 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0320056-0d87-4e03-abe0-6a2447ddbc1e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:46.162518 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b2b9e-aff6-45e4-ae86-6fed0171a04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:46.163156 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b9e-aff6-45e4-ae86-6fed0171a04b service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:46.163443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b9e-aff6-45e4-ae86-6fed0171a04b service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:46.163724 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b9e-aff6-45e4-ae86-6fed0171a04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:46.172617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b2b9e-aff6-45e4-ae86-6fed0171a04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:46.174073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b2b9e-aff6-45e4-ae86-6fed0171a04b service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:46.182750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1316/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:49.134194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f71c-b7ae-4f9c-ab33-f245f5aeb9d3 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:49.193109 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800f71c-b7ae-4f9c-ab33-f245f5aeb9d3 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:49.197602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:49.198458 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:49.198742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:49.199022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] PATH_INFO: `/v3/users/71918fb5ce55441e81d720cfb705cf18` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:49.200249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71918fb5ce55441e81d720cfb705cf18)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:49.202151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:49.248465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71918fb5ce55441e81d720cfb705cf18'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.255627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71918fb5ce55441e81d720cfb705cf18'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.262338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71918fb5ce55441e81d720cfb705cf18'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.264601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71918fb5ce55441e81d720cfb705cf18'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.276665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71918fb5ce55441e81d720cfb705cf18'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.283285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1330/2646] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:55:49 2021] DELETE /identity/v3/users/71918fb5ce55441e81d720cfb705cf18 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:55:49.287909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:49.288386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:49.288595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:49.308069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:55:49.310762 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:49.373308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1317/2647] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:55:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:55:49.383343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:49.384879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:49.441075 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce152bac-d36b-4316-8421-55385d42a8b3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:49.444948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e4e30-86d7-4236-9f5e-745489237495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:49.445571 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e4e30-86d7-4236-9f5e-745489237495 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:49.445860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e4e30-86d7-4236-9f5e-745489237495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:49.446140 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e4e30-86d7-4236-9f5e-745489237495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:49.455956 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e4e30-86d7-4236-9f5e-745489237495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:49.457421 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e4e30-86d7-4236-9f5e-745489237495 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:49.467119 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1331/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:55:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:55:49.731693 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:55:49.733215 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:55:49.745044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2438e9f-076f-47c5-8c53-027299b38845 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:55:49.749788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:55:49.751274 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:55:49.751564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:55:49.751843 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] PATH_INFO: `/v3/projects/2d090b1d654b47668aa54de7bab9a2e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:55:49.753050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d090b1d654b47668aa54de7bab9a2e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:55:49.755039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:55:49.800234 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d090b1d654b47668aa54de7bab9a2e3', 'request_id': 'req-0c7119cd-a9c6-4566-b775-700942b85b65'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.806725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d090b1d654b47668aa54de7bab9a2e3', 'request_id': 'req-0c7119cd-a9c6-4566-b775-700942b85b65'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.813181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d090b1d654b47668aa54de7bab9a2e3', 'request_id': 'req-0c7119cd-a9c6-4566-b775-700942b85b65'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.823080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] The token cache is being invalidate because project 2d090b1d654b47668aa54de7bab9a2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:55:49.823373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.824002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-0c7119cd-a9c6-4566-b775-700942b85b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:55:49.825617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1318/2649] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:55:49 2021] DELETE /identity/v3/projects/2d090b1d654b47668aa54de7bab9a2e3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:01.990806 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d02f3-a26a-4825-9901-ee91e1a3912f None None] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:01.991396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d02f3-a26a-4825-9901-ee91e1a3912f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:01.991396 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d02f3-a26a-4825-9901-ee91e1a3912f None None] PATH_INFO: `/` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:01.993120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1332/2650] 10.222.0.48 () {54 vars in 921 bytes} [Tue Oct 12 16:56:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 16:56:02.003286 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e81ef-911b-4230-9b58-672c111189df None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:02.003856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e81ef-911b-4230-9b58-672c111189df None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:02.003856 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e81ef-911b-4230-9b58-672c111189df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:02.022470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-b41e81ef-911b-4230-9b58-672c111189df None None] MFA Rules not processed for user `671f4f6ff7d84739aecf74e53bb1aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:02.023668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b41e81ef-911b-4230-9b58-672c111189df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:02.078161 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1319/2651] 10.222.0.48 () {58 vars in 1018 bytes} [Tue Oct 12 16:56:02 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:02.090548 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d02f3-a26a-4825-9901-ee91e1a3912f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:02.092338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-544d02f3-a26a-4825-9901-ee91e1a3912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:02.106748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d02f3-a26a-4825-9901-ee91e1a3912f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:02.110407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:02.111049 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:02.111337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:02.111619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:02.119084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:02.120497 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:02.128192 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1333/2652] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:05.918998 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e81ef-911b-4230-9b58-672c111189df None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:05.920474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b41e81ef-911b-4230-9b58-672c111189df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:05.986023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e81ef-911b-4230-9b58-672c111189df None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:05.990539 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:05.991397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:05.991683 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:05.991961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] PATH_INFO: `/v3/users/f23ed6c54b9f47ffb4a2cef5503d5396` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:05.993168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23ed6c54b9f47ffb4a2cef5503d5396)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:05.995113 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.039201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23ed6c54b9f47ffb4a2cef5503d5396'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.039849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23ed6c54b9f47ffb4a2cef5503d5396'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.046688 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23ed6c54b9f47ffb4a2cef5503d5396'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.053973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23ed6c54b9f47ffb4a2cef5503d5396'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.054597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9ddfef3e-7c75-4491-bde9-a023865c014e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23ed6c54b9f47ffb4a2cef5503d5396'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.071199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1320/2653] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:05 2021] DELETE /identity/v3/users/f23ed6c54b9f47ffb4a2cef5503d5396 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:06.237659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.251686 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc1334-d714-47d0-944f-e991d56a5d3c service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.306234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.307115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.307405 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.307687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] PATH_INFO: `/v3/projects/f87a22f14eae4b98ad8daaa62eb5f82a` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.308908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87a22f14eae4b98ad8daaa62eb5f82a)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.310996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.355054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87a22f14eae4b98ad8daaa62eb5f82a', 'request_id': 'req-2a496618-1e02-462b-9744-1f25089e82c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.363322 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87a22f14eae4b98ad8daaa62eb5f82a', 'request_id': 'req-2a496618-1e02-462b-9744-1f25089e82c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.369697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87a22f14eae4b98ad8daaa62eb5f82a', 'request_id': 'req-2a496618-1e02-462b-9744-1f25089e82c2'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.379312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] The token cache is being invalidate because project f87a22f14eae4b98ad8daaa62eb5f82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:06.379604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.380221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-2a496618-1e02-462b-9744-1f25089e82c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:06.381734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1334/2654] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:06 2021] DELETE /identity/v3/projects/f87a22f14eae4b98ad8daaa62eb5f82a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:56:06.387389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7743c-e823-413d-b9aa-008f139bb280 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.387678 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7743c-e823-413d-b9aa-008f139bb280 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.387956 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7743c-e823-413d-b9aa-008f139bb280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.405696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-86c7743c-e823-413d-b9aa-008f139bb280 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:06.407438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-86c7743c-e823-413d-b9aa-008f139bb280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:06.463574 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1321/2655] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:56:06.472110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053be4f-572c-4c31-8a88-420c0d12d0dc None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.472403 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053be4f-572c-4c31-8a88-420c0d12d0dc None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.472687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053be4f-572c-4c31-8a88-420c0d12d0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.491207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-c053be4f-572c-4c31-8a88-420c0d12d0dc None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:06.492397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-c053be4f-572c-4c31-8a88-420c0d12d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:06.500063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1335/2656] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:06.504144 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7743c-e823-413d-b9aa-008f139bb280 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.513583 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7743c-e823-413d-b9aa-008f139bb280 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.518807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.519452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.519740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.520026 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.520779 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:56:06.521089 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.522714 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.534460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1322/2657] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:56:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:56:06.538527 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053be4f-572c-4c31-8a88-420c0d12d0dc None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.547282 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053be4f-572c-4c31-8a88-420c0d12d0dc None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.551877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.552505 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.552790 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.553197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.553777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.555644 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.579798 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1336/2658] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:06 2021] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:06.583816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.593534 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610436aa-861f-4f67-877f-fe6a93ff8354 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.646575 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.647228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.647522 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.647804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.648511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.650476 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.670376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1323/2659] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:06 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:06.674463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.684385 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e81c9-c9dd-44f5-b101-18f1a4acc8c0 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.689270 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.690088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.690800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.690800 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.691409 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.693038 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.704359 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1337/2660] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:06.708175 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.718197 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136c899-c910-4a79-9758-4889555633fa admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.723806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35d92f-dfc2-401d-a982-5c19b91d037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.724462 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d92f-dfc2-401d-a982-5c19b91d037d admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.724752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d92f-dfc2-401d-a982-5c19b91d037d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.725035 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35d92f-dfc2-401d-a982-5c19b91d037d admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.725814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35d92f-dfc2-401d-a982-5c19b91d037d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.727391 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35d92f-dfc2-401d-a982-5c19b91d037d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.737624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1324/2661] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:06.741985 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.752481 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30894652-a8d3-4a70-8143-25bece680401 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.757312 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.758280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.758575 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.758861 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] PATH_INFO: `/v3/projects/726667f6536140938a0da4f7af82411c/users/75231a2c67254b3ca7502dc9080c2336/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.774026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726667f6536140938a0da4f7af82411c, user_id=75231a2c67254b3ca7502dc9080c2336, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.777073 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.790453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1338/2662] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:06 2021] PUT /identity/v3/projects/726667f6536140938a0da4f7af82411c/users/75231a2c67254b3ca7502dc9080c2336/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:06.801257 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa635d1-a11b-4668-9949-dfdcb2821443 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.801595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa635d1-a11b-4668-9949-dfdcb2821443 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.801884 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa635d1-a11b-4668-9949-dfdcb2821443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.828077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0fa635d1-a11b-4668-9949-dfdcb2821443 None None] MFA Rules not processed for user `75231a2c67254b3ca7502dc9080c2336`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:06.829915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0fa635d1-a11b-4668-9949-dfdcb2821443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:06.892496 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1325/2663] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:06 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:06.896902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:06.956552 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af163-9a82-4b15-b864-9afa2f431b20 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:06.961200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:06.961889 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:06.962181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:06.962467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:06.963168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:06.965046 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:06.989227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1339/2664] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:06 2021] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:06.993220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa635d1-a11b-4668-9949-dfdcb2821443 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.004311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa635d1-a11b-4668-9949-dfdcb2821443 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.057511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.058186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.058474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.058757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.059466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.061396 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.080800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1326/2665] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:06 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:07.084728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.095063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f09821-6a59-4b79-8a69-e9a6b2bd299b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.099877 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.100522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.100805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.101089 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.102062 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.103643 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.114262 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1340/2666] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:07.118265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.128703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d69381-dc2a-4034-8025-6bffc54b4d05 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.133458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.134328 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.134615 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.134895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] PATH_INFO: `/v3/projects/b7c6cb34fe4f45deb6e5fb3fb04b7b65/users/83f87272d6a347fd9b177569ba414e3a/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.149508 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c6cb34fe4f45deb6e5fb3fb04b7b65, user_id=83f87272d6a347fd9b177569ba414e3a, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.152383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.167309 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1327/2667] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:07 2021] PUT /identity/v3/projects/b7c6cb34fe4f45deb6e5fb3fb04b7b65/users/83f87272d6a347fd9b177569ba414e3a/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:07.172634 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.182330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278597e-97d9-4331-933a-4dcac826068d admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.236788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789869b-eabc-47b9-8cdc-554ab2580e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.237463 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789869b-eabc-47b9-8cdc-554ab2580e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.237748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789869b-eabc-47b9-8cdc-554ab2580e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.238416 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789869b-eabc-47b9-8cdc-554ab2580e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.238913 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789869b-eabc-47b9-8cdc-554ab2580e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.240531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789869b-eabc-47b9-8cdc-554ab2580e66 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.250141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1341/2668] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:07 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:07.254778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.264909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab14d0-2e99-4762-98f9-9a483b9cc6ff admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.269649 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.270516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.270805 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.271083 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] PATH_INFO: `/v3/projects/b7c6cb34fe4f45deb6e5fb3fb04b7b65/users/83f87272d6a347fd9b177569ba414e3a/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.273070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c6cb34fe4f45deb6e5fb3fb04b7b65, user_id=83f87272d6a347fd9b177569ba414e3a, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.275769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.285704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1328/2669] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:07 2021] PUT /identity/v3/projects/b7c6cb34fe4f45deb6e5fb3fb04b7b65/users/83f87272d6a347fd9b177569ba414e3a/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:07.295587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4088-f9db-4957-9f9a-ceab31d70366 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.295878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4088-f9db-4957-9f9a-ceab31d70366 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.296156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4088-f9db-4957-9f9a-ceab31d70366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.322895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-35cc4088-f9db-4957-9f9a-ceab31d70366 None None] MFA Rules not processed for user `83f87272d6a347fd9b177569ba414e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:07.324117 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-35cc4088-f9db-4957-9f9a-ceab31d70366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:07.390649 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1342/2670] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:07 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:07.400823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.402608 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:07.457199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bdf03-4190-428e-8e4d-b913bddc655f admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.460909 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.461588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.461874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.462157 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.471235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.472660 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.481874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1329/2671] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:07 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:07.549904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4088-f9db-4957-9f9a-ceab31d70366 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:07.559436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4088-f9db-4957-9f9a-ceab31d70366 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:07.563680 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd779dd6-f4b1-40d4-9fa9-194b09bd2e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:07.564305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779dd6-f4b1-40d4-9fa9-194b09bd2e1b service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:07.564586 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779dd6-f4b1-40d4-9fa9-194b09bd2e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:07.564859 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd779dd6-f4b1-40d4-9fa9-194b09bd2e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:07.619834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779dd6-f4b1-40d4-9fa9-194b09bd2e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:07.621597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd779dd6-f4b1-40d4-9fa9-194b09bd2e1b service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:07.631032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1343/2672] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:07 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:46.452892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:46.512163 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e67cc-3056-45d5-ae3d-64d18c018533 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:46.516636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:46.517542 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:46.517831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:46.518108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] PATH_INFO: `/v3/users/75231a2c67254b3ca7502dc9080c2336` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:46.519296 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=75231a2c67254b3ca7502dc9080c2336)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:46.521201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:46.563757 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75231a2c67254b3ca7502dc9080c2336'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:46.564961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75231a2c67254b3ca7502dc9080c2336'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:46.572505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75231a2c67254b3ca7502dc9080c2336'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:46.579483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75231a2c67254b3ca7502dc9080c2336'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:46.580114 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75231a2c67254b3ca7502dc9080c2336'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:46.596813 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1330/2673] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:46 2021] DELETE /identity/v3/users/75231a2c67254b3ca7502dc9080c2336 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:46.601295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:46.601812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:46.601928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:46.619168 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:46.620347 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:46.675710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1344/2674] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:56:46.685740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:46.687135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:46.740645 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357ad2b-eec4-4397-90bf-f9e80f640eaa admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:46.744292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:46.744919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:46.745199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:46.745509 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:46.754190 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:46.755592 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:46.765057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1331/2675] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:47.018665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:47.020112 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:47.031710 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23261b34-a330-41b5-b44d-49d707635d06 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:47.036953 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:47.037823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.038106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.038378 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] PATH_INFO: `/v3/projects/726667f6536140938a0da4f7af82411c` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.039718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=726667f6536140938a0da4f7af82411c)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:47.041529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:47.092817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726667f6536140938a0da4f7af82411c', 'request_id': 'req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.100194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726667f6536140938a0da4f7af82411c', 'request_id': 'req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.106136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726667f6536140938a0da4f7af82411c', 'request_id': 'req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.116372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] The token cache is being invalidate because project 726667f6536140938a0da4f7af82411c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:47.116665 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.117295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.118829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1345/2676] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:47 2021] DELETE /identity/v3/projects/726667f6536140938a0da4f7af82411c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:47.122800 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:47.132168 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14e023-010b-4a81-aa0d-416bb770a943 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:47.187814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:47.188675 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.188952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.189231 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] PATH_INFO: `/v3/users/83f87272d6a347fd9b177569ba414e3a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.190452 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f87272d6a347fd9b177569ba414e3a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:47.192362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:47.235853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f87272d6a347fd9b177569ba414e3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.236479 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f87272d6a347fd9b177569ba414e3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.243387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f87272d6a347fd9b177569ba414e3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.250240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f87272d6a347fd9b177569ba414e3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.251241 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-9573caf2-afc0-4325-97a3-070e8817e3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f87272d6a347fd9b177569ba414e3a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.267316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1332/2677] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:47 2021] DELETE /identity/v3/users/83f87272d6a347fd9b177569ba414e3a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:47.529290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:47.530836 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:47.543455 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf54bf-23ee-433e-b4fe-b3a8831ef5ff admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:47.601147 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:47.602035 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.602582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.602582 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] PATH_INFO: `/v3/projects/b7c6cb34fe4f45deb6e5fb3fb04b7b65` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.603762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c6cb34fe4f45deb6e5fb3fb04b7b65)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:47.605675 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:47.648562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c6cb34fe4f45deb6e5fb3fb04b7b65', 'request_id': 'req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.655196 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c6cb34fe4f45deb6e5fb3fb04b7b65', 'request_id': 'req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.661126 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c6cb34fe4f45deb6e5fb3fb04b7b65', 'request_id': 'req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.671293 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] The token cache is being invalidate because project b7c6cb34fe4f45deb6e5fb3fb04b7b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:47.671576 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.672351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-7b828b3a-36a9-4b3d-b90e-68b81c06b3f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:47.674352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1346/2678] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:47 2021] DELETE /identity/v3/projects/b7c6cb34fe4f45deb6e5fb3fb04b7b65 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:56:47.680355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43c9c-eab3-4be6-a97b-e75055a42797 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.680859 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43c9c-eab3-4be6-a97b-e75055a42797 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.681001 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43c9c-eab3-4be6-a97b-e75055a42797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.698755 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-edd43c9c-eab3-4be6-a97b-e75055a42797 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:47.699981 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-edd43c9c-eab3-4be6-a97b-e75055a42797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:47.755641 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1333/2679] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:47.764557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5adbc-93e7-4830-8bc5-947d5adb7488 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.764854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5adbc-93e7-4830-8bc5-947d5adb7488 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.765142 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5adbc-93e7-4830-8bc5-947d5adb7488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.782858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-a8c5adbc-93e7-4830-8bc5-947d5adb7488 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:47.783977 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-a8c5adbc-93e7-4830-8bc5-947d5adb7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:47.791750 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1347/2680] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:47.795939 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd43c9c-eab3-4be6-a97b-e75055a42797 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:47.805876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd43c9c-eab3-4be6-a97b-e75055a42797 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:47.810360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:47.810994 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.811281 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.811555 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.812278 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:56:47.812630 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:47.814883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:47.825839 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1334/2681] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:56:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:56:47.830031 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5adbc-93e7-4830-8bc5-947d5adb7488 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:47.839086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5adbc-93e7-4830-8bc5-947d5adb7488 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:47.843860 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:47.844498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.844784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.845354 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.846088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:47.847975 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:47.872788 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1348/2682] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:47 2021] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:56:47.877455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:47.887210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513f4fb-7812-486a-ae01-8e98e830101e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:47.941108 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:47.941806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.942097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.942380 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.943375 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:47.945282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:47.964311 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1335/2683] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:47 2021] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:47.968447 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:47.978874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139c1bc-7102-494b-8f57-212422afc445 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:47.983718 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:47.984375 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:47.984661 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:47.984944 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:47.986234 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:47.987837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:47.998063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1349/2684] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:48.002572 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.012441 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cf5f5-fd70-44ad-8651-c63c2d3abbac admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.017038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b3e3d-e20f-4566-816e-8b8fca2158e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.017720 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b3e3d-e20f-4566-816e-8b8fca2158e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.018004 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b3e3d-e20f-4566-816e-8b8fca2158e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.018282 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b3e3d-e20f-4566-816e-8b8fca2158e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.019011 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b3e3d-e20f-4566-816e-8b8fca2158e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.020622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b3e3d-e20f-4566-816e-8b8fca2158e0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.030210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1336/2685] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:48.034380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.044321 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07ae09-6260-45eb-8d11-9bc08b71b798 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.049457 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.050350 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.050637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.050920 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] PATH_INFO: `/v3/projects/881f803a0cad4ae1a214d0e5a9c6ee2f/users/e1d626302c474c4a82cdb216db539031/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.065419 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=881f803a0cad4ae1a214d0e5a9c6ee2f, user_id=e1d626302c474c4a82cdb216db539031, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.068065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.080835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1350/2686] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:48 2021] PUT /identity/v3/projects/881f803a0cad4ae1a214d0e5a9c6ee2f/users/e1d626302c474c4a82cdb216db539031/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:48.090748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b8af9-ba2c-4c26-8831-e993d1f7e0fb None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.091045 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b8af9-ba2c-4c26-8831-e993d1f7e0fb None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.091326 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b8af9-ba2c-4c26-8831-e993d1f7e0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.118397 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-082b8af9-ba2c-4c26-8831-e993d1f7e0fb None None] MFA Rules not processed for user `e1d626302c474c4a82cdb216db539031`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:48.119588 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-082b8af9-ba2c-4c26-8831-e993d1f7e0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:48.181331 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1337/2687] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:48 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:56:48.185758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.245539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ea36-a4fa-4000-b51a-feea3ab9f437 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.250411 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.251066 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.251372 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.251646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.252337 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.254251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.279032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1351/2688] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:48 2021] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:48.283769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b8af9-ba2c-4c26-8831-e993d1f7e0fb None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.294205 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b8af9-ba2c-4c26-8831-e993d1f7e0fb None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.347495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.348189 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.348475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.348756 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.349530 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.351440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.370888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1338/2689] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:48 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:48.374805 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.384892 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3212e-0fa1-439b-9cfb-c1da390a0b85 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.392679 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.393338 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.393659 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.393940 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.394671 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.396257 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.406762 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1352/2690] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:48.411350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.421188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600c694-a5eb-4515-959c-8d069edbe7f0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.426427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.427294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.427578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.427853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] PATH_INFO: `/v3/projects/072b772fe41244b5bd7a03fbd1e5e7df/users/5156362d54774cf498383dcf4ea1096c/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.441852 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072b772fe41244b5bd7a03fbd1e5e7df, user_id=5156362d54774cf498383dcf4ea1096c, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.444493 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.457302 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1339/2691] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:48 2021] PUT /identity/v3/projects/072b772fe41244b5bd7a03fbd1e5e7df/users/5156362d54774cf498383dcf4ea1096c/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:48.461132 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.472006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100daedf-2d8d-4381-b6c0-c50690550786 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.525320 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb474b-eac5-4ca6-849d-f22ec3c51c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.526012 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb474b-eac5-4ca6-849d-f22ec3c51c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.526302 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb474b-eac5-4ca6-849d-f22ec3c51c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.526587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb474b-eac5-4ca6-849d-f22ec3c51c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.527326 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb474b-eac5-4ca6-849d-f22ec3c51c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.528907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb474b-eac5-4ca6-849d-f22ec3c51c19 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.539016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1353/2692] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:48 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:48.543304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.553335 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db54c-1c1c-4f8a-be0f-afb0a4973bc4 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.557962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.558791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.559077 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.559355 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] PATH_INFO: `/v3/projects/072b772fe41244b5bd7a03fbd1e5e7df/users/5156362d54774cf498383dcf4ea1096c/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.561322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=072b772fe41244b5bd7a03fbd1e5e7df, user_id=5156362d54774cf498383dcf4ea1096c, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.563973 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.573895 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1340/2693] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:48 2021] PUT /identity/v3/projects/072b772fe41244b5bd7a03fbd1e5e7df/users/5156362d54774cf498383dcf4ea1096c/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:48.584384 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f61c0-e00c-4e20-9c4a-63d1e1c769b5 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.584682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f61c0-e00c-4e20-9c4a-63d1e1c769b5 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.584966 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f61c0-e00c-4e20-9c4a-63d1e1c769b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.610992 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-fd6f61c0-e00c-4e20-9c4a-63d1e1c769b5 None None] MFA Rules not processed for user `5156362d54774cf498383dcf4ea1096c`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:48.612187 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fd6f61c0-e00c-4e20-9c4a-63d1e1c769b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:48.676845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1354/2694] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:48 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:48.682465 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.740454 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b44d-5d8d-4845-aa74-aa5a6d5812d5 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.745044 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.745916 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.746193 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.746466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] PATH_INFO: `/v3/users/e1d626302c474c4a82cdb216db539031` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.747665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d626302c474c4a82cdb216db539031)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.749589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.793753 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d626302c474c4a82cdb216db539031'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:48.794418 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d626302c474c4a82cdb216db539031'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:48.800976 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d626302c474c4a82cdb216db539031'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:48.807642 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d626302c474c4a82cdb216db539031'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:48.808223 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d626302c474c4a82cdb216db539031'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:48.824901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1341/2695] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:48 2021] DELETE /identity/v3/users/e1d626302c474c4a82cdb216db539031 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:48.829988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.830283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.830563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.847627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:48.848821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:48.903439 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1355/2696] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:48.913229 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:48.914656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:48.971316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43866ac4-8b61-4d6e-8ea0-f478d7a6cdf6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:48.974927 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:48.975595 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:48.975875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:48.976153 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:48.984867 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:48.986320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:48.995406 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1342/2697] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:49.473802 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:49.475247 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:49.487851 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73e14f-3b36-4ba1-b451-43209afd0ac1 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:49.492925 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:49.493812 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:49.494106 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:49.494383 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] PATH_INFO: `/v3/projects/881f803a0cad4ae1a214d0e5a9c6ee2f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:49.495577 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=881f803a0cad4ae1a214d0e5a9c6ee2f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:49.497559 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:49.542183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '881f803a0cad4ae1a214d0e5a9c6ee2f', 'request_id': 'req-3e3a58d7-8512-4327-ad46-edc1829c1500'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.550281 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '881f803a0cad4ae1a214d0e5a9c6ee2f', 'request_id': 'req-3e3a58d7-8512-4327-ad46-edc1829c1500'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.556937 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '881f803a0cad4ae1a214d0e5a9c6ee2f', 'request_id': 'req-3e3a58d7-8512-4327-ad46-edc1829c1500'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.567945 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] The token cache is being invalidate because project 881f803a0cad4ae1a214d0e5a9c6ee2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:49.568240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.568910 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.570747 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1356/2698] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:49 2021] DELETE /identity/v3/projects/881f803a0cad4ae1a214d0e5a9c6ee2f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:49.574763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:49.584801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e1085-624d-46a8-8123-8b1418fc7867 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:49.639467 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:49.640383 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:49.640672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:49.640954 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] PATH_INFO: `/v3/users/5156362d54774cf498383dcf4ea1096c` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:49.642220 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5156362d54774cf498383dcf4ea1096c)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:49.644154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:49.692716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5156362d54774cf498383dcf4ea1096c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.693792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5156362d54774cf498383dcf4ea1096c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.700636 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5156362d54774cf498383dcf4ea1096c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.707320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5156362d54774cf498383dcf4ea1096c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.707960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-cafbfd67-d6a4-48f9-ae5e-9eb222bef683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5156362d54774cf498383dcf4ea1096c'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:49.725518 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1343/2699] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:49 2021] DELETE /identity/v3/users/5156362d54774cf498383dcf4ea1096c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:49.990364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:49.991917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:50.004962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a58d7-8512-4327-ad46-edc1829c1500 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.059974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.060817 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.061102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.061402 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] PATH_INFO: `/v3/projects/072b772fe41244b5bd7a03fbd1e5e7df` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.062702 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] RBAC: Authorizing `identity:delete_project(project_id=072b772fe41244b5bd7a03fbd1e5e7df)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.064709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.109904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '072b772fe41244b5bd7a03fbd1e5e7df', 'request_id': 'req-fc26736d-ad76-4599-bcc0-c47dfe05213f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:50.116988 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '072b772fe41244b5bd7a03fbd1e5e7df', 'request_id': 'req-fc26736d-ad76-4599-bcc0-c47dfe05213f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:50.123114 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '072b772fe41244b5bd7a03fbd1e5e7df', 'request_id': 'req-fc26736d-ad76-4599-bcc0-c47dfe05213f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:50.132842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] The token cache is being invalidate because project 072b772fe41244b5bd7a03fbd1e5e7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:50.133136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:50.133791 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc26736d-ad76-4599-bcc0-c47dfe05213f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:50.135290 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1357/2700] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:49 2021] DELETE /identity/v3/projects/072b772fe41244b5bd7a03fbd1e5e7df => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:50.141137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f18c-399e-4bf8-a0d0-2b6fca2b9a85 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.141457 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f18c-399e-4bf8-a0d0-2b6fca2b9a85 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.142295 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f18c-399e-4bf8-a0d0-2b6fca2b9a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.159616 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-25e8f18c-399e-4bf8-a0d0-2b6fca2b9a85 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:50.160795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-25e8f18c-399e-4bf8-a0d0-2b6fca2b9a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:50.216245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1344/2701] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:56:50.226053 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9d00-53c4-40f7-923c-32211ed6dd9a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.226352 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9d00-53c4-40f7-923c-32211ed6dd9a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.226637 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc9d00-53c4-40f7-923c-32211ed6dd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.244424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-18cc9d00-53c4-40f7-923c-32211ed6dd9a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:50.245683 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-18cc9d00-53c4-40f7-923c-32211ed6dd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:50.253884 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1358/2702] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:50.258062 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f18c-399e-4bf8-a0d0-2b6fca2b9a85 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.268043 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f18c-399e-4bf8-a0d0-2b6fca2b9a85 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.272804 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.273495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.273765 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.274039 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.274760 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:56:50.275066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.276860 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.289037 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1345/2703] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:56:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:56:50.293305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9d00-53c4-40f7-923c-32211ed6dd9a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.302304 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc9d00-53c4-40f7-923c-32211ed6dd9a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.306967 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.307607 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.307897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.308183 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.308887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.310808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.335997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1359/2704] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:50.339961 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.349823 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567804c-c89c-4a06-a3cf-2ec0d6dbe8dd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.406323 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.406982 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.407265 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.407540 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.408235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.410166 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.430147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1346/2705] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:50.434388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.444871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e00a8-5e4d-4dd9-ad42-7629c721750c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.449646 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.450300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.450588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.450871 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.451604 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.453243 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.464134 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1360/2706] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:50.468070 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.477930 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04f8ad-3c68-44c3-8ee9-0f2655d77e52 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.482544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437255c-088d-490e-a80b-c7c5097f67af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.483188 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437255c-088d-490e-a80b-c7c5097f67af admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.483470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437255c-088d-490e-a80b-c7c5097f67af admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.483745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437255c-088d-490e-a80b-c7c5097f67af admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.484578 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437255c-088d-490e-a80b-c7c5097f67af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.486207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437255c-088d-490e-a80b-c7c5097f67af admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.495897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1347/2707] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:50 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:50.499866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.509917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa7c5-0037-4f14-8fc2-c18a9b6f1238 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.514651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.515507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.515789 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.516067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] PATH_INFO: `/v3/projects/cbe2b69e63ed467fbb944b38b7c34d1e/users/bd70bfddef9346d4bae02aead5e4c15e/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.530758 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe2b69e63ed467fbb944b38b7c34d1e, user_id=bd70bfddef9346d4bae02aead5e4c15e, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.533521 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.546082 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1361/2708] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:50 2021] PUT /identity/v3/projects/cbe2b69e63ed467fbb944b38b7c34d1e/users/bd70bfddef9346d4bae02aead5e4c15e/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:50.555886 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e348-0f9f-452b-9033-7517a5e71a76 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.556183 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e348-0f9f-452b-9033-7517a5e71a76 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.556468 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e348-0f9f-452b-9033-7517a5e71a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.582857 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-aa57e348-0f9f-452b-9033-7517a5e71a76 None None] MFA Rules not processed for user `bd70bfddef9346d4bae02aead5e4c15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:50.584057 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-aa57e348-0f9f-452b-9033-7517a5e71a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:50.644581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1348/2709] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:50.648928 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.706709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df72e42-8e64-4687-a91f-717c3709dacb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.711295 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.711934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.712217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.712494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.713181 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.715220 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.739602 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1362/2710] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:50.743502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57e348-0f9f-452b-9033-7517a5e71a76 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.754347 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57e348-0f9f-452b-9033-7517a5e71a76 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.807437 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.808128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.808408 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.808691 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.809470 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.811386 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.830558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1349/2711] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:50.834676 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.844778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74e7d1-9531-4f47-adbb-435511fbbac6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.850200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.851043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.851329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.851606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.852334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.853949 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.865729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1363/2712] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:50 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:50.869709 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.881092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2af13-2b29-43f0-93d5-1c652e74f46b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.885858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a756b5-a568-4c49-a19b-d2dac5ef0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.886500 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a756b5-a568-4c49-a19b-d2dac5ef0db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.886782 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a756b5-a568-4c49-a19b-d2dac5ef0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.887054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a756b5-a568-4c49-a19b-d2dac5ef0db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.887774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a756b5-a568-4c49-a19b-d2dac5ef0db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.889443 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a756b5-a568-4c49-a19b-d2dac5ef0db4 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.898960 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1350/2713] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:50.903093 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:50.912728 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd8c35-efcc-4302-ab05-2cdb4d70469e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:50.917441 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:50.918334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.918617 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.918895 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] PATH_INFO: `/v3/projects/e1cbd1d9f0e04325bddb304792a63350/users/627af4f2cda9492c82fe24afb7dc3a2f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.933608 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1cbd1d9f0e04325bddb304792a63350, user_id=627af4f2cda9492c82fe24afb7dc3a2f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:50.936230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:50.949444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1364/2714] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:50 2021] PUT /identity/v3/projects/e1cbd1d9f0e04325bddb304792a63350/users/627af4f2cda9492c82fe24afb7dc3a2f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:50.960453 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d24e1-7ff7-4a13-b44d-b1fb8b1b8fb6 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:50.960745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d24e1-7ff7-4a13-b44d-b1fb8b1b8fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:50.961019 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d24e1-7ff7-4a13-b44d-b1fb8b1b8fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:50.986989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-183d24e1-7ff7-4a13-b44d-b1fb8b1b8fb6 None None] MFA Rules not processed for user `627af4f2cda9492c82fe24afb7dc3a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:50.988214 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-183d24e1-7ff7-4a13-b44d-b1fb8b1b8fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:51.049900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1351/2715] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:50 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:51.054410 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:51.115067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17b449-da68-4a96-89a0-f1dedfa2888f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:51.119778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:51.120428 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.120715 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.120995 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.121729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:51.123610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:51.148150 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1365/2716] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:56:51 2021] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:56:51.152285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d24e1-7ff7-4a13-b44d-b1fb8b1b8fb6 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:51.163207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d24e1-7ff7-4a13-b44d-b1fb8b1b8fb6 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:51.216076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:51.216729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.217015 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.217294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.218021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:51.220728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:51.239831 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1352/2717] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:56:51 2021] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:56:51.243809 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:51.254330 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573f5df-024b-4021-9b2b-f7d56742bbf3 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:51.259121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:51.259772 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.260060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.260339 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.261102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:51.262734 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:51.272638 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1366/2718] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:51.276580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:51.286874 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310a36c-c3c6-4b00-a51c-12bcc1a8aa44 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:51.291403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:51.292259 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.292543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.292818 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] PATH_INFO: `/v3/projects/53bd439faf384044a22d3cd804876e5e/users/187f912aa32240bbafb620149e89a7c8/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.307581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bd439faf384044a22d3cd804876e5e, user_id=187f912aa32240bbafb620149e89a7c8, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:51.310180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:51.322124 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1353/2719] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:51 2021] PUT /identity/v3/projects/53bd439faf384044a22d3cd804876e5e/users/187f912aa32240bbafb620149e89a7c8/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:51.325879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:51.335538 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca45bf-3a60-4dd8-bb14-32ff8de3e48c admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:51.388917 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bdea1-838f-4047-bc6c-2e3621dd22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:51.389597 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdea1-838f-4047-bc6c-2e3621dd22c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.389888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdea1-838f-4047-bc6c-2e3621dd22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.390172 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bdea1-838f-4047-bc6c-2e3621dd22c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.390897 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bdea1-838f-4047-bc6c-2e3621dd22c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:51.392511 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bdea1-838f-4047-bc6c-2e3621dd22c4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:51.402345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1367/2720] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:56:51 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:56:51.406472 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:51.416847 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625f62-3ec4-4256-b5fa-8ddc30cdfec7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:51.421531 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:51.422387 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.422666 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.423554 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] PATH_INFO: `/v3/projects/53bd439faf384044a22d3cd804876e5e/users/187f912aa32240bbafb620149e89a7c8/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.425543 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bd439faf384044a22d3cd804876e5e, user_id=187f912aa32240bbafb620149e89a7c8, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:51.428137 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:51.437820 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1354/2721] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:56:51 2021] PUT /identity/v3/projects/53bd439faf384044a22d3cd804876e5e/users/187f912aa32240bbafb620149e89a7c8/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:56:51.447748 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.448043 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.448329 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.474690 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] MFA Rules not processed for user `187f912aa32240bbafb620149e89a7c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:51.475880 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:51.539308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1368/2722] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:51 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:51.549066 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:51.550824 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:51.604745 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2939-aae8-47f1-aaa6-d8cfed0ca66b admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:51.608366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:51.608999 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:51.609285 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:51.609594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:51.618367 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:51.619790 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:51.629016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1355/2723] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:51 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:52.063414 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:52.065280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:52.076784 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae6c68-887f-43e8-8f36-14f28a741eaa None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:52.080934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:52.081593 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:52.081876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:52.082149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:52.135156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:52.136585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:52.145681 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1369/2724] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:52 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:56.040567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:56.049440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fa79f-55cc-419b-9244-63f0d008f647 service cinder] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:56.053069 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d599f0-ecd3-449a-a6d9-bd115f81d358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:56.053731 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d599f0-ecd3-449a-a6d9-bd115f81d358 service cinder] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:56.054016 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d599f0-ecd3-449a-a6d9-bd115f81d358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:56.054292 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d599f0-ecd3-449a-a6d9-bd115f81d358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:56.107023 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d599f0-ecd3-449a-a6d9-bd115f81d358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:56.108432 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d599f0-ecd3-449a-a6d9-bd115f81d358 service cinder] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:56.117906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1356/2725] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:56 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:58.077149 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:58.135840 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df34d6-41cb-43f0-a94d-0c7e204d580d service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:58.140355 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:58.141200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:58.142122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:58.142406 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] PATH_INFO: `/v3/users/bd70bfddef9346d4bae02aead5e4c15e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:58.143596 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd70bfddef9346d4bae02aead5e4c15e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:58.145539 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:58.192177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd70bfddef9346d4bae02aead5e4c15e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.199285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd70bfddef9346d4bae02aead5e4c15e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.206051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd70bfddef9346d4bae02aead5e4c15e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.206700 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd70bfddef9346d4bae02aead5e4c15e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.217776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd70bfddef9346d4bae02aead5e4c15e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.223724 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1370/2726] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:58 2021] DELETE /identity/v3/users/bd70bfddef9346d4bae02aead5e4c15e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:58.228333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:58.228812 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:58.228923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:58.245848 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:58.247033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:58.305314 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1357/2727] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:56:58.315866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:58.317236 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:58.372697 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b60b8-f8e9-473c-a85c-6671605aab6f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:58.377344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:58.378014 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:58.378300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:58.378579 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:58.387351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:58.388951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:58.397978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1371/2728] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:56:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:56:58.653914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:58.655336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:58.669065 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bcc6b-b9e8-40aa-ab09-e5eaf8b08ab2 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:58.675202 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:58.676068 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:58.676349 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:58.676625 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] PATH_INFO: `/v3/projects/cbe2b69e63ed467fbb944b38b7c34d1e` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:58.677888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe2b69e63ed467fbb944b38b7c34d1e)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:58.679791 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:58.724806 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe2b69e63ed467fbb944b38b7c34d1e', 'request_id': 'req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.731624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe2b69e63ed467fbb944b38b7c34d1e', 'request_id': 'req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.738185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe2b69e63ed467fbb944b38b7c34d1e', 'request_id': 'req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.747980 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] The token cache is being invalidate because project cbe2b69e63ed467fbb944b38b7c34d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:58.748269 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.748892 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.750438 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1358/2729] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:58 2021] DELETE /identity/v3/projects/cbe2b69e63ed467fbb944b38b7c34d1e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:58.754344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:58.763611 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad00a-4195-49f3-a377-6bd2e125c240 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:58.817127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:58.818024 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:58.818314 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:58.818596 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] PATH_INFO: `/v3/users/627af4f2cda9492c82fe24afb7dc3a2f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:58.819822 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=627af4f2cda9492c82fe24afb7dc3a2f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:58.821768 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:58.865170 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627af4f2cda9492c82fe24afb7dc3a2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.871982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627af4f2cda9492c82fe24afb7dc3a2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.878566 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627af4f2cda9492c82fe24afb7dc3a2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.879200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627af4f2cda9492c82fe24afb7dc3a2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.890835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627af4f2cda9492c82fe24afb7dc3a2f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:58.896835 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1372/2730] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:58 2021] DELETE /identity/v3/users/627af4f2cda9492c82fe24afb7dc3a2f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:59.153517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:59.155040 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:59.168297 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f36c5d-33b2-40d7-a82b-d7fa92b6788e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:59.228855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:59.229738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:59.230021 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:59.230299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] PATH_INFO: `/v3/projects/e1cbd1d9f0e04325bddb304792a63350` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:59.231504 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1cbd1d9f0e04325bddb304792a63350)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:59.233431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:59.276990 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1cbd1d9f0e04325bddb304792a63350', 'request_id': 'req-35bd4fd0-aaaf-452b-b665-39306da3378d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.283899 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1cbd1d9f0e04325bddb304792a63350', 'request_id': 'req-35bd4fd0-aaaf-452b-b665-39306da3378d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.289888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1cbd1d9f0e04325bddb304792a63350', 'request_id': 'req-35bd4fd0-aaaf-452b-b665-39306da3378d'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.299703 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] The token cache is being invalidate because project e1cbd1d9f0e04325bddb304792a63350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:59.299988 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.300622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.302140 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1359/2731] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:59 2021] DELETE /identity/v3/projects/e1cbd1d9f0e04325bddb304792a63350 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:59.306069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:59.307444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:59.320050 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc9b3a-993a-48ce-a5ac-a2341d36d5ea admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:59.373266 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:59.374151 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:59.374436 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:59.374707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] PATH_INFO: `/v3/users/187f912aa32240bbafb620149e89a7c8` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:59.376427 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=187f912aa32240bbafb620149e89a7c8)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:59.378358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:59.419867 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187f912aa32240bbafb620149e89a7c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.426143 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187f912aa32240bbafb620149e89a7c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.432764 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187f912aa32240bbafb620149e89a7c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.433397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187f912aa32240bbafb620149e89a7c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.444908 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-79a3e3f6-ac18-4be4-b0a5-38d6ca638a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187f912aa32240bbafb620149e89a7c8'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.450467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1373/2732] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:56:59 2021] DELETE /identity/v3/users/187f912aa32240bbafb620149e89a7c8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:59.704712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:59.706136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:59.718793 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4fd0-aaaf-452b-b665-39306da3378d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:59.773050 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:59.773926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:59.774222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:59.774483 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] PATH_INFO: `/v3/projects/53bd439faf384044a22d3cd804876e5e` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:59.775656 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53bd439faf384044a22d3cd804876e5e)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:59.777705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:56:59.820735 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53bd439faf384044a22d3cd804876e5e', 'request_id': 'req-22b0cc1f-e27c-48d1-8150-627950f89f41'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.827076 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53bd439faf384044a22d3cd804876e5e', 'request_id': 'req-22b0cc1f-e27c-48d1-8150-627950f89f41'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.832997 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53bd439faf384044a22d3cd804876e5e', 'request_id': 'req-22b0cc1f-e27c-48d1-8150-627950f89f41'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.842858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] The token cache is being invalidate because project 53bd439faf384044a22d3cd804876e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:56:59.843147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.843777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-22b0cc1f-e27c-48d1-8150-627950f89f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:56:59.845563 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1360/2733] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:56:59 2021] DELETE /identity/v3/projects/53bd439faf384044a22d3cd804876e5e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:56:59.852227 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae360325-c3f9-4b9f-b58c-4017559a237a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:59.852516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae360325-c3f9-4b9f-b58c-4017559a237a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:59.852801 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae360325-c3f9-4b9f-b58c-4017559a237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:59.872315 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-ae360325-c3f9-4b9f-b58c-4017559a237a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:59.873599 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-ae360325-c3f9-4b9f-b58c-4017559a237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:59.930178 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1374/2734] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:59.939436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9fd2-a9a6-4be5-8d8a-7d8481d60666 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:59.939725 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9fd2-a9a6-4be5-8d8a-7d8481d60666 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:59.940009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d9fd2-a9a6-4be5-8d8a-7d8481d60666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:59.957868 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-2a2d9fd2-a9a6-4be5-8d8a-7d8481d60666 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:56:59.959002 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-2a2d9fd2-a9a6-4be5-8d8a-7d8481d60666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:56:59.967014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1361/2735] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:56:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:56:59.971452 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae360325-c3f9-4b9f-b58c-4017559a237a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:56:59.981065 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae360325-c3f9-4b9f-b58c-4017559a237a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:56:59.986221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:56:59.986866 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:56:59.987158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:56:59.987444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:56:59.988173 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80072) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:56:59.988486 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:56:59.990110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.002006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1375/2736] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:56:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 16:57:00.006268 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9fd2-a9a6-4be5-8d8a-7d8481d60666 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.015573 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d9fd2-a9a6-4be5-8d8a-7d8481d60666 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.020498 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.021155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.021474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.021759 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.022460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.024419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.049306 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1362/2737] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:57:00 2021] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:00.053478 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.063382 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e540d8-22a5-4d7f-9db9-070c5e413883 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.117947 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.118610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.118904 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.119189 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.119898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.121833 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.140197 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1376/2738] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:57:00 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:00.144505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.154593 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd792d-26ef-47cc-8ad2-2fc0fed64817 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.159787 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.160436 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.160728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.161009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.161776 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.163365 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.174085 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1363/2739] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:00.177971 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.188154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afec859-b9fd-4786-b2b1-b43cbef8e7c4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.192907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8332-0c44-4ae6-b61e-ea9e8b58ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.193588 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8332-0c44-4ae6-b61e-ea9e8b58ba47 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.193878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8332-0c44-4ae6-b61e-ea9e8b58ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.194156 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8332-0c44-4ae6-b61e-ea9e8b58ba47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.194887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def8332-0c44-4ae6-b61e-ea9e8b58ba47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.196451 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def8332-0c44-4ae6-b61e-ea9e8b58ba47 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.206185 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1377/2740] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:57:00.210329 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.219853 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43627634-520a-47f3-87c9-b17d76bb4e35 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.225304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.226199 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.226490 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.226774 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] PATH_INFO: `/v3/projects/56f6f8fd63a84a02b33f77fe2f147e33/users/d663939a23194691ba565d2c82470d0a/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.241243 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f6f8fd63a84a02b33f77fe2f147e33, user_id=d663939a23194691ba565d2c82470d0a, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.243923 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.256362 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1364/2741] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:00 2021] PUT /identity/v3/projects/56f6f8fd63a84a02b33f77fe2f147e33/users/d663939a23194691ba565d2c82470d0a/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:00.268200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c6c6-b8e2-4c20-b7f2-601cfe9c021b None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.268498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c6c6-b8e2-4c20-b7f2-601cfe9c021b None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.268781 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c6c6-b8e2-4c20-b7f2-601cfe9c021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.294621 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-e117c6c6-b8e2-4c20-b7f2-601cfe9c021b None None] MFA Rules not processed for user `d663939a23194691ba565d2c82470d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:00.295878 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-e117c6c6-b8e2-4c20-b7f2-601cfe9c021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:00.356230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1378/2742] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:00 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:57:00.360801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.421926 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47498879-74d1-4b30-ae5f-f9b571ec35c7 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.426648 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.427280 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.427594 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.427777 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.428475 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.430403 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.455626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1365/2743] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:57:00 2021] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:00.459741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c6c6-b8e2-4c20-b7f2-601cfe9c021b None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.470086 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c6c6-b8e2-4c20-b7f2-601cfe9c021b None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.523845 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.524534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.524818 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.525096 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] PATH_INFO: `/v3/users` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.525837 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.527740 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.547158 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1379/2744] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:57:00 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 16:57:00.551419 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.561552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad770-9c3c-406c-b17e-80c7f1e6b420 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.566154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.566801 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.567088 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.567366 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.568098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.569711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.580333 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1366/2745] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:00.584217 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.594102 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afc38-4b0e-4fa7-acf7-30d1147b7958 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.599562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.600417 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.600701 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.600978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] PATH_INFO: `/v3/projects/0953304059704ec58a79f6727ab3731f/users/9ba2a36f070f416f975abadeaaeb8c24/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.615137 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0953304059704ec58a79f6727ab3731f, user_id=9ba2a36f070f416f975abadeaaeb8c24, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.618026 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.629914 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1380/2746] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:00 2021] PUT /identity/v3/projects/0953304059704ec58a79f6727ab3731f/users/9ba2a36f070f416f975abadeaaeb8c24/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:57:00.633705 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.644300 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa25510-6df7-4233-9101-02d2350a0219 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.696746 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae4321-de5e-445c-ba11-6d5aa097ddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.697422 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4321-de5e-445c-ba11-6d5aa097ddec admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.697712 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4321-de5e-445c-ba11-6d5aa097ddec admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.697995 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae4321-de5e-445c-ba11-6d5aa097ddec admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.698732 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae4321-de5e-445c-ba11-6d5aa097ddec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.700351 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae4321-de5e-445c-ba11-6d5aa097ddec admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.710350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1367/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:00 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:00.714498 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.725465 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67168c10-8d24-4b8f-b01c-45559dbc7beb admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.730110 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.730973 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.731260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.731537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] PATH_INFO: `/v3/projects/0953304059704ec58a79f6727ab3731f/users/9ba2a36f070f416f975abadeaaeb8c24/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.733532 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0953304059704ec58a79f6727ab3731f, user_id=9ba2a36f070f416f975abadeaaeb8c24, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.736213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.746084 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1381/2748] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:00 2021] PUT /identity/v3/projects/0953304059704ec58a79f6727ab3731f/users/9ba2a36f070f416f975abadeaaeb8c24/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:00.755834 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281b4f-8dc2-4d54-84ce-9818ba239531 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.756130 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281b4f-8dc2-4d54-84ce-9818ba239531 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.756414 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281b4f-8dc2-4d54-84ce-9818ba239531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.783819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-79281b4f-8dc2-4d54-84ce-9818ba239531 None None] MFA Rules not processed for user `9ba2a36f070f416f975abadeaaeb8c24`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:00.785020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-79281b4f-8dc2-4d54-84ce-9818ba239531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:00.849893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1368/2749] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:00 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:57:00.859838 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:00.861663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:00.916108 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbbb23e-b793-4591-a4fc-53ccb5c2ff22 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:00.919922 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c900d-d065-4546-9216-1decafbcd9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:00.920585 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c900d-d065-4546-9216-1decafbcd9da service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:00.920874 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c900d-d065-4546-9216-1decafbcd9da service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:00.921154 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c900d-d065-4546-9216-1decafbcd9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:00.932279 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c900d-d065-4546-9216-1decafbcd9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:00.933741 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c900d-d065-4546-9216-1decafbcd9da service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:00.944098 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1382/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:00 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:57:01.268497 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281b4f-8dc2-4d54-84ce-9818ba239531 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:01.326598 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281b4f-8dc2-4d54-84ce-9818ba239531 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:01.331185 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:01.332034 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:01.332320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:01.332597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] PATH_INFO: `/v3/users/d663939a23194691ba565d2c82470d0a` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:01.333822 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d663939a23194691ba565d2c82470d0a)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:01.335738 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:01.379246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd663939a23194691ba565d2c82470d0a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.379945 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd663939a23194691ba565d2c82470d0a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.387176 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd663939a23194691ba565d2c82470d0a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.393993 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd663939a23194691ba565d2c82470d0a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.394643 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd663939a23194691ba565d2c82470d0a'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.411162 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1369/2751] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:57:01 2021] DELETE /identity/v3/users/d663939a23194691ba565d2c82470d0a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:01.415667 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:01.416159 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:01.416277 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:01.433808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:01.434997 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:01.491830 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1383/2752] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:01.502461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:01.503789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:01.558266 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699a61a-6e97-4fa8-a238-6fa8589244fc admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:01.561922 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:01.562564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:01.562849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:01.563128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:01.571921 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:01.573399 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:01.582589 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1370/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:57:01.836285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:01.837765 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:01.851563 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9dfb6-baa5-448f-ba41-34fd7f4b1b9a None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:01.856174 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:01.857018 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:01.857308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:01.857636 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] PATH_INFO: `/v3/projects/56f6f8fd63a84a02b33f77fe2f147e33` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:01.859025 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f6f8fd63a84a02b33f77fe2f147e33)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:01.860912 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:01.907221 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f6f8fd63a84a02b33f77fe2f147e33', 'request_id': 'req-fc2917ac-102f-4c17-922d-62445bfea8d6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.915454 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f6f8fd63a84a02b33f77fe2f147e33', 'request_id': 'req-fc2917ac-102f-4c17-922d-62445bfea8d6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.921601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f6f8fd63a84a02b33f77fe2f147e33', 'request_id': 'req-fc2917ac-102f-4c17-922d-62445bfea8d6'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.931695 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] The token cache is being invalidate because project 56f6f8fd63a84a02b33f77fe2f147e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:57:01.931996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.932663 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:01.934245 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1384/2754] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:57:01 2021] DELETE /identity/v3/projects/56f6f8fd63a84a02b33f77fe2f147e33 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:01.938141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:01.947672 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a935a-efb5-4764-88e9-abfcdcface88 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.001141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.002056 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.002338 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.002624 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] PATH_INFO: `/v3/users/9ba2a36f070f416f975abadeaaeb8c24` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.003816 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba2a36f070f416f975abadeaaeb8c24)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.005773 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.049172 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba2a36f070f416f975abadeaaeb8c24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.049775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba2a36f070f416f975abadeaaeb8c24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.056644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba2a36f070f416f975abadeaaeb8c24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.063119 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba2a36f070f416f975abadeaaeb8c24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.063758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1bc612bb-4c3b-463c-b2ed-6c850c086e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba2a36f070f416f975abadeaaeb8c24'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.080591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1371/2755] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:57:01 2021] DELETE /identity/v3/users/9ba2a36f070f416f975abadeaaeb8c24 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:02.337876 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.339300 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:02.352274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2917ac-102f-4c17-922d-62445bfea8d6 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.407389 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.408294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.408578 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.408854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] PATH_INFO: `/v3/projects/0953304059704ec58a79f6727ab3731f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.410069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0953304059704ec58a79f6727ab3731f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.411965 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.456753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0953304059704ec58a79f6727ab3731f', 'request_id': 'req-253f3319-f069-4801-b134-18296c6b0c66'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.463444 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0953304059704ec58a79f6727ab3731f', 'request_id': 'req-253f3319-f069-4801-b134-18296c6b0c66'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.469398 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0953304059704ec58a79f6727ab3731f', 'request_id': 'req-253f3319-f069-4801-b134-18296c6b0c66'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.479390 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] The token cache is being invalidate because project 0953304059704ec58a79f6727ab3731f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:57:02.479682 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.480361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-253f3319-f069-4801-b134-18296c6b0c66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:02.481890 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1385/2756] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:57:02 2021] DELETE /identity/v3/projects/0953304059704ec58a79f6727ab3731f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:57:02.489690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e7548-3554-4ead-9674-96442365bf67 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.490135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e7548-3554-4ead-9674-96442365bf67 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.490256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e7548-3554-4ead-9674-96442365bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.509358 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-9c5e7548-3554-4ead-9674-96442365bf67 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:02.510597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-9c5e7548-3554-4ead-9674-96442365bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:02.566466 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1372/2757] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:02.574515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e9f2-aed0-4789-9c3d-a480d83fcb9f None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.574808 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e9f2-aed0-4789-9c3d-a480d83fcb9f None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.575088 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070e9f2-aed0-4789-9c3d-a480d83fcb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.593364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-9070e9f2-aed0-4789-9c3d-a480d83fcb9f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:02.594587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-9070e9f2-aed0-4789-9c3d-a480d83fcb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:02.602862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1386/2758] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:02.606835 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e7548-3554-4ead-9674-96442365bf67 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.616291 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e7548-3554-4ead-9674-96442365bf67 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.620889 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.621564 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.621858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.622135 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.622858 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:57:02.623164 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.624796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.636313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1373/2759] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:57:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:57:02.640297 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e9f2-aed0-4789-9c3d-a480d83fcb9f None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.649882 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070e9f2-aed0-4789-9c3d-a480d83fcb9f None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.654626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.655260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.655544 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.655823 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.656525 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.658531 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.683515 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1387/2760] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:57:02 2021] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:02.687661 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.698350 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846ee0b-e128-4ac1-996f-891428707dce admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.751495 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.752689 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.753003 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.753283 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.754022 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.755952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.774716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1374/2761] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:57:02 2021] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:02.778610 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.788547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123621-fe4c-4442-aa13-ef60b01db42e admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.793343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.794324 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.794650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.794936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.795664 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.797319 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.807870 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1388/2762] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:02.811605 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.821781 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7941a6-fcf1-4617-a034-8d508af28df9 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.826431 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f617-d631-4101-b09a-31dfcbb72dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.827075 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f617-d631-4101-b09a-31dfcbb72dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.827363 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f617-d631-4101-b09a-31dfcbb72dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.827644 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f617-d631-4101-b09a-31dfcbb72dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.828373 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f617-d631-4101-b09a-31dfcbb72dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.830033 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f617-d631-4101-b09a-31dfcbb72dd1 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.839792 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1375/2763] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:02 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:02.843459 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.853122 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52506783-a50b-4181-a359-9157ce559a3b admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:02.857669 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:02.858522 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.858804 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.859081 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] PATH_INFO: `/v3/projects/a41fc5458f6646c5ad071b4063544501/users/16a66b8141ff4f4b97e00f53e1722f8f/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.873252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41fc5458f6646c5ad071b4063544501, user_id=16a66b8141ff4f4b97e00f53e1722f8f, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:02.875903 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:02.889022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1389/2764] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:02 2021] PUT /identity/v3/projects/a41fc5458f6646c5ad071b4063544501/users/16a66b8141ff4f4b97e00f53e1722f8f/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:02.895474 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a9614-05c7-4bd7-a05d-8e13ffccdd6f None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:02.895769 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a9614-05c7-4bd7-a05d-8e13ffccdd6f None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:02.896054 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a9614-05c7-4bd7-a05d-8e13ffccdd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:02.913322 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-0d6a9614-05c7-4bd7-a05d-8e13ffccdd6f None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:02.914567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0d6a9614-05c7-4bd7-a05d-8e13ffccdd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:02.971460 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1376/2765] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:02.981274 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:02.983067 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:03.038169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3df70-274f-4c34-ac62-59d41ae17028 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:03.042077 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:03.042731 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:03.043020 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:03.043308 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:03.052753 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:03.054210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:03.063367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1390/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:57:03.643695 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a92a1b-3c32-42c4-b022-77eb0fbcf09b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:03.644207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a92a1b-3c32-42c4-b022-77eb0fbcf09b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:03.644313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a92a1b-3c32-42c4-b022-77eb0fbcf09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:03.670228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-81a92a1b-3c32-42c4-b022-77eb0fbcf09b None None] MFA Rules not processed for user `16a66b8141ff4f4b97e00f53e1722f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:03.671477 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-81a92a1b-3c32-42c4-b022-77eb0fbcf09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:03.734740 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1377/2767] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:03 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:03.744745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:03.746344 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:03.801351 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753f9b-edc6-4a93-9370-76bd3a5c8572 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:03.805056 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:03.805743 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:03.806032 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:03.806340 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:03.815200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:03.816627 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:03.825651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1391/2768] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:03 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:57:05.155626 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:05.156148 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:05.156260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:05.173710 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] MFA Rules not processed for user `16a66b8141ff4f4b97e00f53e1722f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:05.174906 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:05.181700 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1378/2769] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:05 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:06.122962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:06.124422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:06.192951 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dea63-0d18-4f01-bed2-8628dd3f3391 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:06.198202 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:06.198847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:06.199162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:06.199483 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:06.201271 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:06.212500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:06.214124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:06.224252 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1392/2770] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:06 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:57:47.564901 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:47.566376 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:47.583134 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c351e-e2b6-404c-9434-ffb0bd869d23 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:47.587650 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:47.588505 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:47.588788 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:47.589063 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] PATH_INFO: `/v3/users/942a19220f2349388b9549bdbab6ff4b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:47.590299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=942a19220f2349388b9549bdbab6ff4b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:47.592207 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:47.636538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942a19220f2349388b9549bdbab6ff4b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.637242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942a19220f2349388b9549bdbab6ff4b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.644568 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942a19220f2349388b9549bdbab6ff4b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.651180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942a19220f2349388b9549bdbab6ff4b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.651752 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942a19220f2349388b9549bdbab6ff4b'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.667711 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1379/2771] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:57:47 2021] DELETE /identity/v3/users/942a19220f2349388b9549bdbab6ff4b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:47.837305 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:47.847962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db368446-949f-445b-8389-158f0d4f53f6 service placement] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:47.906256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:47.907099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:47.907380 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:47.907655 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] PATH_INFO: `/v3/projects/b73d362cc56e4184b1481cb51a6186e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:47.908825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73d362cc56e4184b1481cb51a6186e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:47.910742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:47.953978 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73d362cc56e4184b1481cb51a6186e3', 'request_id': 'req-1682d29a-f42e-4350-8526-b94f752948ba'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.960554 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73d362cc56e4184b1481cb51a6186e3', 'request_id': 'req-1682d29a-f42e-4350-8526-b94f752948ba'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.966962 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73d362cc56e4184b1481cb51a6186e3', 'request_id': 'req-1682d29a-f42e-4350-8526-b94f752948ba'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.977601 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] The token cache is being invalidate because project b73d362cc56e4184b1481cb51a6186e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:57:47.977887 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.978558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:47.980063 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1393/2772] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:57:47 2021] DELETE /identity/v3/projects/b73d362cc56e4184b1481cb51a6186e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:47.983979 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:47.985359 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:47.998821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49a8a-d057-4e08-8936-6905609e67b0 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.051729 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.052622 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.052907 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.053883 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] PATH_INFO: `/v3/users/9ccd4aaa2f794e318997751296d697f5` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.055094 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccd4aaa2f794e318997751296d697f5)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.057032 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.100523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccd4aaa2f794e318997751296d697f5'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.101174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccd4aaa2f794e318997751296d697f5'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.108523 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccd4aaa2f794e318997751296d697f5'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.116551 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccd4aaa2f794e318997751296d697f5'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.117192 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-8561f857-d905-44bb-94e2-75b5137fb2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccd4aaa2f794e318997751296d697f5'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.133599 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1380/2773] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:57:47 2021] DELETE /identity/v3/users/9ccd4aaa2f794e318997751296d697f5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:48.301152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.302707 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:48.315739 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682d29a-f42e-4350-8526-b94f752948ba admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.370935 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.371782 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.372069 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.372345 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] PATH_INFO: `/v3/projects/1e4d368849104fd1a63230e27fb3bcfd` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.373564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4d368849104fd1a63230e27fb3bcfd)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.375472 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.418968 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4d368849104fd1a63230e27fb3bcfd', 'request_id': 'req-27d1e888-c136-4dd2-98eb-c40998fe921e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.426590 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4d368849104fd1a63230e27fb3bcfd', 'request_id': 'req-27d1e888-c136-4dd2-98eb-c40998fe921e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.433076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4d368849104fd1a63230e27fb3bcfd', 'request_id': 'req-27d1e888-c136-4dd2-98eb-c40998fe921e'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.444207 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] The token cache is being invalidate because project 1e4d368849104fd1a63230e27fb3bcfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:57:48.444503 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.445152 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-27d1e888-c136-4dd2-98eb-c40998fe921e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:57:48.446726 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1394/2774] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:57:48 2021] DELETE /identity/v3/projects/1e4d368849104fd1a63230e27fb3bcfd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:48.452327 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e0143-acb9-45e3-9276-52ced79453b7 None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.452617 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e0143-acb9-45e3-9276-52ced79453b7 None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.452893 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e0143-acb9-45e3-9276-52ced79453b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.471861 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-142e0143-acb9-45e3-9276-52ced79453b7 None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:48.473041 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-142e0143-acb9-45e3-9276-52ced79453b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:48.527758 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1381/2775] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:48.536504 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6df-065e-495e-a475-45130e37d1da None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.536795 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6df-065e-495e-a475-45130e37d1da None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.537076 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6df-065e-495e-a475-45130e37d1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.555474 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-b285e6df-065e-495e-a475-45130e37d1da None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:48.556712 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-b285e6df-065e-495e-a475-45130e37d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:48.564369 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1395/2776] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:48.568313 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e0143-acb9-45e3-9276-52ced79453b7 None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.578020 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e0143-acb9-45e3-9276-52ced79453b7 None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.582567 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.583261 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.583663 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.583950 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.585180 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80071) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 16:57:48.585517 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.587105 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.598550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1382/2777] 10.222.0.48 () {58 vars in 1152 bytes} [Tue Oct 12 16:57:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 16:57:48.603358 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e6df-065e-495e-a475-45130e37d1da None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.612397 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e6df-065e-495e-a475-45130e37d1da None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.617291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.617974 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.618263 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.618547 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.619256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.621141 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.648424 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1396/2778] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:57:48 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:48.652550 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.662405 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddef8b-d553-4b8c-bb54-b022dec088cd admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.715952 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.716609 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.716897 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.717179 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.717949 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.719855 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.742256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1383/2779] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:57:48 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:48.743364 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.753260 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4bae3-baf2-47a4-ac4c-c689466e45f2 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.758407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.759055 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.759341 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.759622 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.760388 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.762017 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.773979 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1397/2780] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:57:48.777962 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.787440 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c089ee-b44c-423c-8f3f-a515c5f6da7d admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.792107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c243a3-f529-45e8-a50c-44bee9d238db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.792749 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c243a3-f529-45e8-a50c-44bee9d238db admin admin] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.793036 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c243a3-f529-45e8-a50c-44bee9d238db admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.793315 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c243a3-f529-45e8-a50c-44bee9d238db admin admin] PATH_INFO: `/v3/roles` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.794073 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c243a3-f529-45e8-a50c-44bee9d238db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.795640 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c243a3-f529-45e8-a50c-44bee9d238db admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.805240 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1384/2781] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:48 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:48.809223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.819283 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414ce5-0ba5-488d-8d78-cd294db7be20 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:48.823858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:48.824705 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.824986 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.825259 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] PATH_INFO: `/v3/projects/dfe6bb8a0d1d4df4bb014ed753e2a895/users/059e4cee933049768938995208dc80fe/roles/cc9b9740cce14af58694140b57aad8e3` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.839619 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe6bb8a0d1d4df4bb014ed753e2a895, user_id=059e4cee933049768938995208dc80fe, role_id=cc9b9740cce14af58694140b57aad8e3)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:48.842251 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:48.854982 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1398/2782] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:48 2021] PUT /identity/v3/projects/dfe6bb8a0d1d4df4bb014ed753e2a895/users/059e4cee933049768938995208dc80fe/roles/cc9b9740cce14af58694140b57aad8e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 16:57:48.859931 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41650eae-94b2-40c1-ba5d-5c65e88dbbfd None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:48.860255 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41650eae-94b2-40c1-ba5d-5c65e88dbbfd None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:48.860538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41650eae-94b2-40c1-ba5d-5c65e88dbbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:48.878741 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-41650eae-94b2-40c1-ba5d-5c65e88dbbfd None None] MFA Rules not processed for user `d4d408e2598343a193d18277dfdc0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:48.879934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-41650eae-94b2-40c1-ba5d-5c65e88dbbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:48.934721 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1385/2783] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:48.945155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:48.946858 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:49.011557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aff2b1-8c23-4ec8-948f-8f7e993d62d4 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:49.013693 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:49.014327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:49.014623 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:49.014907 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:49.025200 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:49.026674 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:49.036124 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1399/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:57:52.908924 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32ee9e-6dec-463a-9867-2589faebb40b None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:52.909455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32ee9e-6dec-463a-9867-2589faebb40b None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:52.909716 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32ee9e-6dec-463a-9867-2589faebb40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:52.936967 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-df32ee9e-6dec-463a-9867-2589faebb40b None None] MFA Rules not processed for user `059e4cee933049768938995208dc80fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:52.938455 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-df32ee9e-6dec-463a-9867-2589faebb40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:53.004459 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1386/2785] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:52 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:53.009199 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:53.019534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93cd9a-87bf-429a-8b6f-f361102ec185 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:53.025016 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:53.025723 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:53.026177 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:53.026645 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] PATH_INFO: `/v3/projects` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:53.027540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:53.029654 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:53.064336 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1400/2786] 10.222.0.48 () {60 vars in 1152 bytes} [Tue Oct 12 16:57:53 2021] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:53.067896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32ee9e-6dec-463a-9867-2589faebb40b None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:53.082116 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32ee9e-6dec-463a-9867-2589faebb40b None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:53.147478 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:53.148293 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:53.148888 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:53.148998 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:53.149698 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:53.151789 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:53.185071 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1387/2787] 10.222.0.48 () {60 vars in 1143 bytes} [Tue Oct 12 16:57:53 2021] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 16:57:53.187061 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:53.216749 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a36c76-8bd6-483d-8957-27a64d58818f admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:53.225104 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:53.225924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:53.226280 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:53.226630 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:53.227709 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:53.229399 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:53.243009 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1401/2788] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 16:57:53.251279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:53.266098 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d753a-c3c6-4950-a868-7297d038dad2 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:53.271256 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:53.272727 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:53.273009 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:53.273288 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] PATH_INFO: `/v3/projects/cd6b01435a4e4be18497a1dd1fb5500e/users/3845e3853cb84f1f91e924d4aa01bc93/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:53.291245 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6b01435a4e4be18497a1dd1fb5500e, user_id=3845e3853cb84f1f91e924d4aa01bc93, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:53.294138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:53.312155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1388/2789] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:53 2021] PUT /identity/v3/projects/cd6b01435a4e4be18497a1dd1fb5500e/users/3845e3853cb84f1f91e924d4aa01bc93/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:53.313226 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:53.324373 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f13b3d-a272-4e4d-a03c-c62dc4d46317 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:53.382162 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd74d61-775b-4876-8b61-4d5bf435cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:53.382883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd74d61-775b-4876-8b61-4d5bf435cf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:53.383169 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd74d61-775b-4876-8b61-4d5bf435cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:53.383445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd74d61-775b-4876-8b61-4d5bf435cf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:53.384223 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd74d61-775b-4876-8b61-4d5bf435cf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:53.386210 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd74d61-775b-4876-8b61-4d5bf435cf81 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:53.397613 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1402/2790] 10.222.0.48 () {58 vars in 1121 bytes} [Tue Oct 12 16:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 16:57:53.401920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:53.412458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724979c-6d7e-4d9f-b447-4cc48a3f48a6 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:53.419826 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:53.420667 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:53.420957 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:53.421246 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] PATH_INFO: `/v3/projects/cd6b01435a4e4be18497a1dd1fb5500e/users/3845e3853cb84f1f91e924d4aa01bc93/roles/3a471e61998d4a34b97fef6a8964c88b` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:53.423461 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6b01435a4e4be18497a1dd1fb5500e, user_id=3845e3853cb84f1f91e924d4aa01bc93, role_id=3a471e61998d4a34b97fef6a8964c88b)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:53.426558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:53.439658 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1389/2791] 10.222.0.48 () {60 vars in 1482 bytes} [Tue Oct 12 16:57:53 2021] PUT /identity/v3/projects/cd6b01435a4e4be18497a1dd1fb5500e/users/3845e3853cb84f1f91e924d4aa01bc93/roles/3a471e61998d4a34b97fef6a8964c88b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:57:57.769431 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab2087-905c-41ef-87b0-88ed0a33ebaf None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:57.769933 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab2087-905c-41ef-87b0-88ed0a33ebaf None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:57.770054 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab2087-905c-41ef-87b0-88ed0a33ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:57.796948 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-8eab2087-905c-41ef-87b0-88ed0a33ebaf None None] MFA Rules not processed for user `3845e3853cb84f1f91e924d4aa01bc93`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:57:57.798115 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8eab2087-905c-41ef-87b0-88ed0a33ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:57.868239 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1403/2792] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:57:57 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:57:57.879337 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:57:57.881115 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:57:57.971046 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb8577-709a-4ddf-88c9-a368ab1797e3 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:57:57.977519 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:57:57.978222 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:57:57.978516 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:57:57.978796 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:57:58.033312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:57:58.035064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:57:58.045811 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1390/2793] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:57:57 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:11.905113 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f177-27c2-4002-88bf-3e3548350f75 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:11.905570 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f177-27c2-4002-88bf-3e3548350f75 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:11.905854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8f177-27c2-4002-88bf-3e3548350f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:11.923445 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-eab8f177-27c2-4002-88bf-3e3548350f75 None None] MFA Rules not processed for user `16a66b8141ff4f4b97e00f53e1722f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:11.924684 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-eab8f177-27c2-4002-88bf-3e3548350f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:11.979291 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1404/2794] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:58:11 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 16:58:12.203748 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:12.256154 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4570012-3a8f-4a17-9fab-c151c34df08e service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:12.260381 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c81e69-e48c-41e3-b29d-06f9dc3513f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:12.261028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81e69-e48c-41e3-b29d-06f9dc3513f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:12.261320 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81e69-e48c-41e3-b29d-06f9dc3513f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:12.261627 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c81e69-e48c-41e3-b29d-06f9dc3513f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:12.263427 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-22c81e69-e48c-41e3-b29d-06f9dc3513f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:12.273238 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c81e69-e48c-41e3-b29d-06f9dc3513f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:12.274690 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c81e69-e48c-41e3-b29d-06f9dc3513f4 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:12.282544 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1391/2795] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:12.589278 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f177-27c2-4002-88bf-3e3548350f75 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:12.599148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8f177-27c2-4002-88bf-3e3548350f75 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:12.603299 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:12.603941 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:12.604230 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:12.604514 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:12.606362 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:12.620792 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:12.622256 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:12.633064 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1405/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:16.541253 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] REQUEST_METHOD: `POST` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:16.541798 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:16.541900 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:16.558357 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.auth.core [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] MFA Rules not processed for user `059e4cee933049768938995208dc80fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80071) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 16:58:16.559552 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:16.566434 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1392/2797] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 16:58:16 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 16:58:16.600240 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:16.601763 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:16.655051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9f6b-8e46-4f01-b3dd-7344f2ca9247 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:16.658624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e128ed2736b4158ae2009df5ba23fe6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:16.659250 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:16.659534 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:16.659810 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:16.661529 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:16.674129 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:16.675540 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:16.686249 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1406/2798] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:31.009875 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:31.011248 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:31.022775 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef782-f18a-4869-943c-4be00f01586d None None] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:31.026402 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:31.027034 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:31.027316 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:31.027591 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:31.029260 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:31.038529 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:31.040014 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:31.047920 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1393/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:31 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:35.966136 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:35.975557 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facd065-e12c-4918-8c8a-ba976e2f4392 service cinder] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:35.979685 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:35.980316 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:35.980605 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:35.980888 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:35.989606 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:35.991022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:36.000900 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1407/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:35 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 16:58:46.166352 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:58:46.181558 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8aa5c1-48b4-450d-92ca-79bd293da52f service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:58:46.188704 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:58:46.189392 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:58:46.189846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:58:46.190125 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:58:46.192581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:58:46.207136 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:58:46.208876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:58:46.220155 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1394/2801] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 16:58:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 16:59:09.579542 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:09.581121 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 16:59:09.646051 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf58f1-7fcd-4593-bb2e-590e3a9d15b1 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:09.650844 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:09.651742 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:09.652028 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:09.652310 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] PATH_INFO: `/v3/users/16a66b8141ff4f4b97e00f53e1722f8f` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:09.653558 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a66b8141ff4f4b97e00f53e1722f8f)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:09.655495 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:09.700085 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a66b8141ff4f4b97e00f53e1722f8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:09.706924 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a66b8141ff4f4b97e00f53e1722f8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:09.713333 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a66b8141ff4f4b97e00f53e1722f8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:09.713996 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a66b8141ff4f4b97e00f53e1722f8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:09.725327 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8e2680a0-f883-4d2d-ac2a-c1f4060e3678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a66b8141ff4f4b97e00f53e1722f8f'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:09.731862 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1408/2802] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 16:59:09 2021] DELETE /identity/v3/users/16a66b8141ff4f4b97e00f53e1722f8f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 16:59:09.898149 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 16:59:09.909194 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f02023-bfd8-45a0-b2ed-b9ebd8add2eb service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 16:59:09.962264 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 16:59:09.963107 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 16:59:09.963389 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 16:59:09.963665 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] PATH_INFO: `/v3/projects/a41fc5458f6646c5ad071b4063544501` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 16:59:09.964840 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41fc5458f6646c5ad071b4063544501)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 16:59:09.967304 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 16:59:10.011000 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41fc5458f6646c5ad071b4063544501', 'request_id': 'req-1c0d9527-cc15-478e-aa26-2787cd908039'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:10.017919 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41fc5458f6646c5ad071b4063544501', 'request_id': 'req-1c0d9527-cc15-478e-aa26-2787cd908039'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:10.023942 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41fc5458f6646c5ad071b4063544501', 'request_id': 'req-1c0d9527-cc15-478e-aa26-2787cd908039'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:10.034538 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] The token cache is being invalidate because project a41fc5458f6646c5ad071b4063544501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80071) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 16:59:10.034821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:10.035435 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 16:59:10.036958 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1395/2803] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 16:59:09 2021] DELETE /identity/v3/projects/a41fc5458f6646c5ad071b4063544501 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:00:38.509587 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:38.510164 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:38.510285 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:38.539294 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] MFA Rules not processed for user `059e4cee933049768938995208dc80fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:00:38.540507 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:38.617313 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1409/2804] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 17:00:38 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:00:39.142064 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.143471 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.236138 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d9527-cc15-478e-aa26-2787cd908039 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.239838 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.240480 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.240763 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.241042 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.242795 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.253502 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.254915 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.262621 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1396/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:39.682537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:39.683926 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.758813 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ebe5e-1ba8-4187-aad2-6425065a14e2 None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:39.763847 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:39.764487 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:39.764777 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:39.765620 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:39.767361 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:39.778650 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:39.780213 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:39.790446 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1410/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:39 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:53.522685 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:53.524117 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:53.598521 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce0c66-d0bf-438c-89f0-8e2bc09f5f51 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:53.604074 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:53.604715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:53.604998 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:53.605277 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:53.607102 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:53.619684 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:53.621581 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:53.631726 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1397/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:00:57.516687 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:00:57.530148 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0051c-f6b7-4828-ac13-2588310f669b service placement] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:00:57.535879 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d82671-1346-461b-95a9-e501e0aac80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:00:57.536537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d82671-1346-461b-95a9-e501e0aac80a service nova] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:00:57.536821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d82671-1346-461b-95a9-e501e0aac80a service nova] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:00:57.537099 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d82671-1346-461b-95a9-e501e0aac80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:00:57.539041 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-56d82671-1346-461b-95a9-e501e0aac80a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:00:57.551825 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d82671-1346-461b-95a9-e501e0aac80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:00:57.553564 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d82671-1346-461b-95a9-e501e0aac80a service nova] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:00:57.565453 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1411/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:00:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:02:27.649586 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:02:27.650989 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:27.686174 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f1d27-62c8-44c1-a04f-a782f6553580 service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:02:27.691147 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:02:27.691778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:27.692058 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:27.692332 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:27.694080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:27.705668 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:02:27.707210 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:02:27.716846 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1398/2809] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:02:27 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:02:37.164021 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859ccc-6d6e-4715-9b4b-c24a92d3299c None None] REQUEST_METHOD: `POST` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:02:37.164516 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859ccc-6d6e-4715-9b4b-c24a92d3299c None None] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:02:37.164624 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51859ccc-6d6e-4715-9b4b-c24a92d3299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:02:37.181821 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.auth.core [None req-51859ccc-6d6e-4715-9b4b-c24a92d3299c None None] MFA Rules not processed for user `059e4cee933049768938995208dc80fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80072) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 17:02:37.183006 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-51859ccc-6d6e-4715-9b4b-c24a92d3299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:02:37.190562 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1412/2810] 10.222.0.48 () {58 vars in 957 bytes} [Tue Oct 12 17:02:37 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 17:04:29.717423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:29.718968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:29.730430 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb33f02-6e16-41e9-bb13-366f1084a70a service placement] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:29.734047 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:29.734676 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:29.734996 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:29.735279 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:29.737511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:29.746629 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:29.748038 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:29.756360 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1399/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:29 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:32.279625 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51859ccc-6d6e-4715-9b4b-c24a92d3299c None None] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:32.289738 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51859ccc-6d6e-4715-9b4b-c24a92d3299c None None] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:32.293171 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:32.293834 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:32.294118 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:32.294392 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:32.296120 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:32.306367 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:32.307778 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:32.316708 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1413/2812] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:32 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:33.163442 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:33.166141 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:33.249294 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb6b8-5c83-4e87-8548-ba0f1f9f48d4 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:33.258696 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ce1b443aa425c99aab2ca8e6b53c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:33.260152 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:33.260728 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:33.261308 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:33.264287 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:33.290242 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:33.291968 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:33.305048 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1400/2813] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:33.345022 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:33.354194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53308234-5eaa-46e2-aeb0-d0ebcff1afb0 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:33.358100 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:33.358729 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:33.359013 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:33.359343 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:33.361060 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:33.375854 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:33.377244 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:33.389045 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1414/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:34.567305 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:34.576491 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad082c-2e01-4667-be63-7d5b1849dd72 service nova] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:34.580080 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:34.581458 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:34.581750 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:34.582028 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:34.583778 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:34.596742 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:34.598196 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:34.609095 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1401/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:45.522898 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:45.531494 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a3959-3dd3-4212-b77b-e17c02955929 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:45.535138 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '671f4f6ff7d84739aecf74e53bb1aba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:45.536334 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] REQUEST_METHOD: `GET` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:45.536632 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:45.536902 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:45.538651 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:45.621500 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:45.622936 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:45.641745 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1415/2816] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:04:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 17:04:51.887814 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:51.889652 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:51.904181 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26c96f-3c21-423d-bc5e-9d6a947ddc65 service neutron] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:51.909299 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:51.910312 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:51.911232 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:51.911876 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] PATH_INFO: `/v3/users/059e4cee933049768938995208dc80fe` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:51.913235 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059e4cee933049768938995208dc80fe)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:51.915423 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:51.965914 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059e4cee933049768938995208dc80fe'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:51.966580 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059e4cee933049768938995208dc80fe'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:51.973341 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059e4cee933049768938995208dc80fe'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:51.980186 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059e4cee933049768938995208dc80fe'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:51.980821 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059e4cee933049768938995208dc80fe'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:51.997228 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1402/2817] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 17:04:51 2021] DELETE /identity/v3/users/059e4cee933049768938995208dc80fe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:04:52.164094 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:52.174467 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5422a-fce7-4ae7-b5ce-8fb2c136d365 service neutron] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:52.230991 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:52.231842 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:52.232127 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:52.232407 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] PATH_INFO: `/v3/projects/dfe6bb8a0d1d4df4bb014ed753e2a895` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:52.233626 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe6bb8a0d1d4df4bb014ed753e2a895)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:52.235506 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:52.279071 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe6bb8a0d1d4df4bb014ed753e2a895', 'request_id': 'req-8d7e755a-ec1b-498f-b972-b11c2eeea790'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.286186 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe6bb8a0d1d4df4bb014ed753e2a895', 'request_id': 'req-8d7e755a-ec1b-498f-b972-b11c2eeea790'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.292194 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe6bb8a0d1d4df4bb014ed753e2a895', 'request_id': 'req-8d7e755a-ec1b-498f-b972-b11c2eeea790'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.302537 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] The token cache is being invalidate because project dfe6bb8a0d1d4df4bb014ed753e2a895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:04:52.302829 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.303466 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.305007 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1416/2818] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 17:04:52 2021] DELETE /identity/v3/projects/dfe6bb8a0d1d4df4bb014ed753e2a895 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:04:52.309097 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:52.310511 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:52.323604 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e17284-a091-4618-8eca-4bc6881aa100 admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:52.376674 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:52.377562 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:52.377849 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:52.378128 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] PATH_INFO: `/v3/users/3845e3853cb84f1f91e924d4aa01bc93` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:52.379343 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3845e3853cb84f1f91e924d4aa01bc93)` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:52.381254 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:52.424819 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3845e3853cb84f1f91e924d4aa01bc93'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.425413 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3845e3853cb84f1f91e924d4aa01bc93'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.432131 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3845e3853cb84f1f91e924d4aa01bc93'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.438597 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3845e3853cb84f1f91e924d4aa01bc93'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.439203 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.notifications [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3845e3853cb84f1f91e924d4aa01bc93'} {{(pid=80071) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.455092 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1403/2819] 10.222.0.48 () {58 vars in 1223 bytes} [Tue Oct 12 17:04:52 2021] DELETE /identity/v3/users/3845e3853cb84f1f91e924d4aa01bc93 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:04:52.618883 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Authenticating user token {{(pid=80072) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:04:52.620382 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.fernet_utils [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80072) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:04:52.637146 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e755a-ec1b-498f-b972-b11c2eeea790 admin admin] Validating token access rules against request {{(pid=80072) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:04:52.692193 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d408e2598343a193d18277dfdc0252', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64da0972f6f84075a0e8956810e3e6c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80072) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:04:52.692998 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:04:52.693284 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:04:52.693591 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] PATH_INFO: `/v3/projects/cd6b01435a4e4be18497a1dd1fb5500e` {{(pid=80072) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:04:52.694776 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6b01435a4e4be18497a1dd1fb5500e)` {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:04:52.696660 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] RBAC: Authorization granted {{(pid=80072) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:04:52.741155 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6b01435a4e4be18497a1dd1fb5500e', 'request_id': 'req-f3b4f6e8-e96d-4583-a59d-953b4dda7440'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.748167 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6b01435a4e4be18497a1dd1fb5500e', 'request_id': 'req-f3b4f6e8-e96d-4583-a59d-953b4dda7440'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.754163 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6b01435a4e4be18497a1dd1fb5500e', 'request_id': 'req-f3b4f6e8-e96d-4583-a59d-953b4dda7440'} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.763934 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] The token cache is being invalidate because project cd6b01435a4e4be18497a1dd1fb5500e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80072) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 17:04:52.764248 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.764873 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: DEBUG keystone.notifications [None req-f3b4f6e8-e96d-4583-a59d-953b4dda7440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80072) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 17:04:52.766422 dv-cinder-813221-2-iscsi devstack@keystone.service[80072]: [pid: 80072|app: 0|req: 1417/2820] 10.222.0.48 () {58 vars in 1232 bytes} [Tue Oct 12 17:04:52 2021] DELETE /identity/v3/projects/cd6b01435a4e4be18497a1dd1fb5500e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 17:07:34.001896 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Authenticating user token {{(pid=80071) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 17:07:34.003336 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:34.069934 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0dc85-cee1-4478-8133-2e7d1b70435e admin admin] Validating token access rules against request {{(pid=80071) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 17:07:34.132545 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b8f6d-e30a-4395-82d6-f53ad94fe932 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32dbbc4af72f4d11a9b1876dba8e886f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f119466674a340b69452f507c88cfdf6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80071) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 17:07:34.133201 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8f6d-e30a-4395-82d6-f53ad94fe932 service placement] REQUEST_METHOD: `GET` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 17:07:34.133520 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8f6d-e30a-4395-82d6-f53ad94fe932 service placement] SCRIPT_NAME: `/identity` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 17:07:34.133807 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b8f6d-e30a-4395-82d6-f53ad94fe932 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80071) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 17:07:34.135601 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.fernet_utils [None req-4d9b8f6d-e30a-4395-82d6-f53ad94fe932 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80071) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 17:07:34.146654 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b8f6d-e30a-4395-82d6-f53ad94fe932 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 17:07:34.148239 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b8f6d-e30a-4395-82d6-f53ad94fe932 service placement] RBAC: Authorization granted {{(pid=80071) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 17:07:34.158715 dv-cinder-813221-2-iscsi devstack@keystone.service[80071]: [pid: 80071|app: 0|req: 1404/2821] 10.222.0.48 () {60 vars in 1365 bytes} [Tue Oct 12 17:07:34 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)